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GENE FREQUENCIES IN A CLINE DETERMINED 
BY SELECTION AND DIFFUSION 


R. A. FIsHer 
University of Cambridge 


1. The ecological problem. 


iF 1937 (1) the author studied the distribution of the gene ratio in the 
simple case of an advantageous gene advancing along a linear habitat 
under a constant selective advantage. In Nature situations must be 
more complex than in this simple model; in particular it must often occur 
that the selective advantage itself varies with position. The interest- 
ing case arises in which a gene enjoys a selective advantage in one part of 
a species’ range, while in the remainder it is at a selective disadvantage. 
On the boundary between these regions selection is neutral between two 
allelomorphic genes. 

Cases can be observed in practice in which there is a gradient, or 
cline, in the frequencies of the genotypes determined by a single factor. 
Generally such cases will be complicated by inequalities of topography, 
and by consequent irregularities in the population density, and in the 
gradient of selective advantage. It is to be expected also that the boun- 
dary will in general neither be straight (i.e. a great circle of the earth’s 
surface), nor constant in position under the conditions prevailing in 
different years. Any model worth discussing from a theoretical stand- 
point will therefore be a drastically simplified one, playing the part of a 
basis for comparisons by which the real complexities of each situation 
may be critically demonstrated. 

The purely genetical complication of non-recognition of genotype, 
due to dominance, is also ignored. This is chiefly because I should regard 
the occurrence of true dominance in such cases as a danger-signal sug- 
gesting the very different genetic situation of a balanced polymorphism; 
partly because if on more careful examination it is found that the hetero- 
zygote is recognisable this will greatly increase the value of the observa- 
tions. 

The problem chosen for discussion, as an extension of my work of 
1937, thus differs materially from that considered by Haldane in 1948 
(2). Haldane discusses the effects of a discontinuous selective intensity 
acting on a gene ratio obscured by dominance. 

The available data, in the common case, will consist of gene frequen- 
cies observed at chosen centres of collection. From such data the 
primary need is to determine the neutral, or 50%, line, and the distances 
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TABLE I 


FUNDAMENTAL TABLE, GIVING THE SOLUTION OF THE 
DIFFERENTIAL EQUATION (1) 


x q x qd x q 

-00 .5000 0000 1.00 .1004 2286 2.00 0077 7553 
.02 .4895 1717 1.02 .0962 0743 2.02 .0073 3125 
04 -4790 4235 1.04 .0921 3390 2.04 .0069 1050 
06 .4685 8348 1.06 .O881 9955 2.06 .0065 1215 
.08 .4581 4852 1.08 .0844 0159 2.08 0061 3513 
-10 4477 4533 elo .0807- 3716 2.10 .0057 7840 
12 .4373 8169 1.12 .0772 0335 2.12 .0054 4098 
14 .4270 6529 1.14 .0737 9721 2.14 .0051 2192 
16 .4168 0369 1.16 .0705 1573 2.16 .0048 2031 
-18 .4066 0430 1.18 -0673 5591 2.18 .0045 3528 
-20 .3964 7438 1.20 .0643 1468 2.20 .0042 6600 
-22 .38864 2102 1.22 .0613 8899 2.22 -0040 1168 
+24 .38764 5110 1.24 .0585 7578 2.24 0037 7155 
-26 .38665 7130 1.26 .0558 7198 2.26 .0035 4489 
-28 .38567 8807 1.28 0532 7452 2.28 -0033 3101 
-30 -38471 0763 1.30 -0507 8036 2.30 .0031 2924 
82 -8375 3596 1.32 .0483 8646 2.32 .0029 3895 
384 .38280 7874 1.34 -0460 8981 2.34 0027 5954 
-36 .8187 4142 1.36 .0438 8742 2.36 -0025 9044 
-38 .3095 2916 1.38 .0417 7635 2.38 -0024 3109 
-40 .8004 4681 1.40 .0397 5367 2.40 .0022 8099 
-42 -2914 9895 1.42 .0378 1649 2.42 -0021 3962 
-44 -2826 8985 1.44 .0359 6200 2.44 -0020 0652 
-46 .2740 2349 1.46 .0341 8738 2.46 .0018 8124 
-48 -2655 0351 1.48 .0324 8990 2.48 .0017 6336 
-50 .2571 3327 1.50 .0308 6686 2.50 0016 5246 
-52 .2489 1582 1.52 -0293 1561 2.52 0015 4816 
-54 -2408 5390 1.54 .0278 3358 2.54 .0014 5010 
-56 -2329 4992 1.56 .0264 1823 2.56 -0013 5792 
-58 .2252 0602 1.58 .0250 6707 2.58 .0012 7130 
-60 .2176 2403 1.60 .0237 7771 2.60 .0011 8992 
62 .2102 0546 1.62 .0225 4777 2.62 0011 1348 
-64 .2029 5155 1.64 .0213 7496 2.64 .0010 4171 
66 .1958 6327 1.66 .0202 5705 2.66 -0009 7434 
-68 -1889 4129 1.68 .0191 9186 2.68 0009 1111 
-70 .1821 8602 1.70 0181 7727 2.70 .0008 5178 
ay) .1755 9759 1.72 -0172 1122 2.72 .0007 9613 
74 .1691 7592 1.74 -0162 9174 2.74 .0007 4395 
-76 .1629 2064 1.76 .0154 1687 2.76 .0006 9502 
78 .1568 3117 1.78 .0145 8475 2.78 .0006 4916 
-80 .1509 0672 1.80 -0137 9358 2.80 -0006 0619 
82 .1451 4627 1.82 .0130 4158 2.82 -0005 6594 
84 .1395 4859 1.84 .0123 2707 2.84 .0005 2823 
-86 .1341 1227 1.86 .0116 4841 2.86 0004 9293 
-88 .1288 3573 1.88 0110 0401 2.88 -0004 5988 
-90 .1237 1721 1.90 .0103 9235 2.90 -0004 2895 
92 -1187 5479 1.92 -0098 1197 2.92 .0004 0001 
94 .1139 4640 1.94 .0092 61438 2.94 .0003 7294 
-96 .1092 8985 1.96 .0087 3938 2.96 .0003 4763 
-98 .1047 8282 1298 -OO82 4450 2.98 .0003 2396 
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TABLE I—Continwed 


FUNDAMENTAL TABLE, GIVING THE SOLUTION OF THE 


DIFFERENTIAL EQUATION (1) 


300 


= qa x q G q 
3.00 .0003 0183 4.00 .0000 0670 5.00 .0000 0009 
3.02 .0002 8115 4.02 .0000 0618 5.02 .0000 0008 
3.04 .0002 6183 4.04 .0000 0570 5.04 .0000 0008 
3.06 .0002 4379 4.06 .0000 0525 5.06 .0000 0007 
3.08 0002 2694 4.08 .0000 0484 5.08 .0000 0006 
3.10 .0002 1121 4.10 .0000 0446 5.10 .0000 0006 
3.12 0001 9652 4.12 .0000 0410 5.12 .0000 0005 
3.14 .0001 8282 4.14 .0000 0378 5.14 -0000 0005 
3.16 .0001 7003 4.16 .0000 0348 5.16 -0000 0004 
3.18 0001 5811 4.18 .0000 0320 5.18 .0000 0004 
3.20 0001 4699 4.20 .0000 0295 5.20 0000 0004 
3.22 .0001 3662 4.22 .0000 0271 5.22 .0000 0003 
3.24 .0001 2696 4.24 .0000 0250 5.24 .0000 0003 
3.26 0001 1795 4.26 .0000 0230 5.26 0000 0003 
3.28 .0001 0956 4.28 .0000 0211 5.28 .0000 0003 
3.30 0001 0175 4.30 .0000 0194 5.30 .0000 0002 
3.32 .0000 9447 4.32 .0000 0178 5.32 .0000 0002 
3.34 0000 8769 4.34 .0000 0164 5.34 .0000 0002 
3.36 0000 8139 4.36 .0000 0151 5.36 .0000 0002 
3.38 0000 7552 4.38 .0000 0138 5.38 .0000 0002 
3.40 0000 7006 4.40 .0000 0127 5.40 .0000 0001 
3.42 .0000 6498 4.42 .0000 0117 5.42 .0000 0001 
3.44 .0000 6026 4.44 .0000 0107 5.44 .0000 0001 
3.46 0000 5586 4.46 .0000 0098 5.46 .0000 0001 
3.48 0000 5178 4.48 .0000 0090 5.48 .0000 0001 
3.50 0000 4799 4.50 .0000 0083 5.50 .0000 0001 
3.52 0000 4446 4.52 .0000 0076 5.52 .0000 OO00L 
3.54 0000 4119 4 54 .0000 0070 5.54 .0000 0001 
3.56 0000 3815 4,56 .0000 0064 5.56 .0000 0001 
3.58 0000 3532 4.58 .0000 0059 5.58 .0000 0001 
3.60 0000 3270 4.60 .0000 0054 5.60 .0000 0001 
3.62 0000 3027 4.62 .0000 0049 5.62 .0000 0001 
3.64 0000 2801 4.64 .0000 0045 5.64 .0000 0000 
3.66 0000 2591 4.66 0000 0041 5.66 .0000 0000 
3.68 0000 2397 4.68 .0000 0038 5.68 .0000 0000 
3.70 0000 2217 4.70 .0000 0035 5.70 .0000 0000 
3.72 0000 2050 4.72 .0000 0032 
3.74 0000 1895 4.74 .0000 0029 
3.76 0000 1752 4.76 .0000 0027 
3.78 0000 1619 4.78 .0000 0024 
3.80 0000 1495 4.80 .0000 0022 
3.82 0000 1381 4.82 .0000 0020 
3.84 0000 1276 4.84 .0000 0019 
3.86 0000 1178 4.86 .0000 0017 
3.88 0000 1087 4.88 -0000 0016 
3.90 0000 1004 4.90 .0000 0014 
3.92 0000 0926 4.92 .0000 0013 
3.94 0000 0855 4.94 .0000 0012 
3.96 0000 0788 4.96 .0000 0011 
3.98 0000 0727 4.98 .0000 0010 
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from this at which other percentages are to be expected. The scale of 
these distances is an important observational feature, depending on the 
diffusional mobility of the species, and on the intensity of the selective 
gradient. 


2. Mathematical formulation. 


The frequency p of a gene depends only on the coordinate 2, as in a 
linear habitat. 

In the case in which the gene with frequency p has a selective 
advantage 7 (defined as rate of change of logarithmic gene ratio, (3) 
pp. 70-72)) proportional to x, and x varies without limit in both direc- 
tions, the rate of increase due to selection is 

dp 5 
i PY = Pd gt, 
where g is the gradient of selective advantage, and gq = 1 — p. 

Suppose also a uniform population density with a diffusion constant 

k such that the rate of increase in gene frequency (p) at any point is 


2 2 
eee #9 


ie = da” 
due to diffusion. In 1937 I discussed the limitations and justification of 
the analogy with physical diffusion. 
Then the gene ratio will adjust itself so as to tend to satisfy the equa- 
tion of equilibrium, 
2 


dq 
de PY 9 i 


we may choose the unit of length in which the position x is measured, 
so that 


g = Ak, 


and the relation between qg and x is then given by the equation 


2 


dq 
dat + TPO 


with the boundary conditions (1) 
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TABLE II 
STANDARDIZED DEVIATES (LEGITS) FOR GIVEN GENE PERCENTAGES 


Gene Gene @ene 
percentage Deviate percentage Deviate percentage Deviate 
50 . 00000 20.0 . 64827 5.0 1.30643 
49 .01908 19.5 . 66247 4.8 1.32331 
48 .03817 19.0 .67691 4.6 1.34080 
47 .05729 18.5 .69161 4.4 1.35896 
46 .07645 18.0 . 70658 4.2 1.37784 
45 .09566 17.5 . 72184 4.0 1.39752 
44 . 11493 17.0 . 73740 3.8 1.41807 
43 . 13429 16.5 . 75329 3.6 1.43958 
42 . 15375 16.0 . 76952 3.4 1.46216 
41 - 173382 15.5 . 78612 3.2 1.48594 
40 . 19302 15.0 . 80311 3.0 1.51106 
39 . 21286 14.5 82052 2.8 1.53771 
38 . 23286 14.0 . 83837 2.6 1.56609 
37 . 25304 13.5 . 85669 2.4 1.59648 
36 . 27341 13.0 .87553 2.2 1.62922 
35 . 29400 12.5 . 89492 2.0 1.66474 
34 .31483 12.0 . 91492 il 8) 1.70360 
33 . 383592 11.5 . 93556 6 1.74656 
32 .380729 11.0 .95691 1.4 1.79468 
31 .37897 10.5 .97902 4 1.84951 
30 - 40099 10.0 1.00198 1.0 1.91340 
29 . 42338 9.5 1.02586 0.9 1.94988 
28 -44617 9.0 1.05076 0.8 1.99029 
27 . 46940 8.5 1.07680 0.7 2.03565 
26 .49311 8.0 1.10411 0.6 2.08745 
25 .51734 7.5 1.13285 0.5 2.14795 
24 .54214 ew 1.16321 0.4 2.22095 
23 .56757 6.5 1.19543 0.3 2.31345 
22 . 59369 6.0 1.22978 0.2 2.44101 
21 . 62056 5.5 1.26662 (0), 2.65223 


Values of q to eight decimal places, from « = 0, by intervals of .02, 
to extinction, are given in Table I. I owe this tabulation to Dr. M. V. 
Wilkes and Mr. D. J. Wheeler, operating the EDSAC electronic com- 
puter. The last decimal place may be in error by 3 or 4 units. From 
this primary Table I have calculated Table II, giving the deviation x 
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TABLE III 
APPARATUS FOR FINAL FITTING 


Provi- Working Legit | Weight-| Provi- Working Legit Weight- 
sional © |—————_—————__|_ ing sional ing 
Legit Max. Min. Coeff. Legit Max. Min. Coeff. 
.00 .9538 — .9538} 1.0992 1.50 1.8891 | —10.7156) .2104 
nO) .9623 — .9636} 1.0903 1.60 1.9776 | —13.905 .1708 
.20 9857 — .9960} 1.0648 1.70 2.0673 | —18.135 . 1373 
30 1.0211 | —1.0564) 1.0224 1.80 2.1577 | —23.773 .1093 
.40 1.0665 | —1.1518) .9669 1.90 2.2489 | —31.321 .0863 
50 1.1200 | —1.2913} .9004 2.00 2.3407 | —41.478 .0675 
. 60 1.1803 | —1.4862) .8260 2.10 2.4331 | —55.218 .0524 
LO) 1.2461 | —1.7515) .7469 2.20 2.5261 | —73.906 .0403 
.80 1.3166 | —2.1067| .6659 2.30 2.6194 | —99.459 .0308 
.90 1.3909 | —2.5772) .5858 2.40 2.7132 |—134.599 .0233 
1.00 1.4685 | —38.1965} .5087 2.50 2.8073 |—183.17 .0175 
il 1@ 1.5487 | —4.0090) .4362 2.60 2.9018 |—250.70 .0131 
1.20 1.6312 | —5.0736| .3697 2 2.9965 |—3845.11 .0097 
1.30 1.7156 | —6.4693] .3097 2.80 3.0916 |—477.90 .0071 
1.40 1.8017 | —8.3021} .2566 2.90 3.1868 |—665.39 .0052 
1.50 1.8891 |—10.7156} .2104 3.00 3.2822 |—931.73 .0038 


corresponding with 90 chosen probabilities g, and Table III, supplying 
the computational apparatus analogous to that used in probit analysis 
of mortality data in toxicology. 

To appreciate this analogy g may be regarded as the probability of a 
variate exceeding x in a certain symmetrical distribution. 2 is thus a 
transformation of gq which, under the hypothesis, is linear with—and 
subject to choice of units as explained above is equal to—the distance 
from the neutral line. 

For the normal distribution with unit variance this probability tends 
to zero in such a way that 


log 1/q¢ + 42° > 1 
as x is increased. For the distribution for which 


2x = logp — log q, 


dp 


L 2 
rp 9 sech 2} 
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we have 
log 1/q + 2x > 1. 
The case with which we are concerned falls between these two, for 
log 1/q tends at the limit to equality with 4 2°””. 
The relation between the three forms may also be shown from their 
properties at or near the median. Here we may consider 
ap . ‘i 
ir Nie 
which is dimensionless, and therefore a pure measure of form. For this 
ratio we find 


ratio 
Normal transformation Probit 2r 6.2832 
Logarithmic transformation Logit a 8.0000 
Selection-diffusion transformation Legit (1.90764)° 6.9421 


Since it has been found convenient to distinguish the deviates in the 
two first cases as Probits and Logits respectively, a similar term such as 
Legit may be found convenient for the standardised deviate of the dis- 
tribution obtained above from a uniform cline of selection. 

The dimensional nature of the quantities k and g involved in the 


provisional identity 


g = 4k 
is determined by 
Ke cay 1G Tee 
ae Saad ke 
hence 
ep 
g 


In setting this quantity equal to unity, therefore, we are merely adopting 
a unit of length appropriate to our problem, and this unit of length may 


now be defined as 


a will then be the distance separating the line on which q is 10.04... .% 
from the line of 50%, and that in turn from the line having 89.96. . nhs 


of the chosen gene. 
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3. Fitting the data. 


For any observed gene-frequency the corresponding deviate can be 
read off from Table II. Since the primary data allow of it, five places of 
decimals have been given. It should, I think, only be used to three 
places. Gene frequencies (q) greater than 50% have corresponding 
negative deviates. Each empirical percentage has been based on twice 
as many genes as organisms have been classified; these double numbers 
should be multiplied by the weighting factors of Table HI corresponding 
with the deviate obtained. No high precision of weighting is usually 
called for, since the data will probably contain some observations with 
0 or 100%, and these cannot be included at the first stage. In all other 
cases the observed sample supplies a deviate, an appropriate weight, and 
two geographical coordinates \ and yw determining its position. 

The first step is then to find a weighted regression equation, 


xX = Do + bir ap bom, 


in which the coefficients by , b; and b; have been adjusted so as to mini- 
mise the weighted sum of squares 


S{wle — X)?}. 


The (first) estimated position of the neutral line is then given by the 
equation, 


bo + b:A + bop = 0; 
and its distance from the parallel lines 


bo + biA + boyy = +1 


provides an estimate of the scaling distance a. 

No great labour need be expended on this stage of the work, the 
purpose of which is to provide provisional deviates X, with which to 
proceed. Usually indeed somewhat simplified values of by , b; and bz 
are next substituted for those actually obtained, using values judged to 
be sufficiently near to those to be finally obtained. 

For what will probably be the final fitting these provisional values, 
X, corresponding to the position of each sample observed, will be used 
to enter Table III. If 0% have been observed for g the working Legit 
has its maximum value as tabulated. Linear interpolation in 2 is gen- 
erally sufficient. If 100%, the minimum is used, and for intermediate 
percentages the difference between these is divided proportionally. It is 
usually convenient at this stage to multiply the minimum by the actual 
number of genes recorded, the maximum by the number of allelomorphic 
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genes, and to divide the total by twice the number of organisms ob- 
served, before interpolation for the provisional value required. The 
weighting coefficients corresponding with the same provisional values, 
multiplied by twice the observed number of organisms, give the working 
weights. 

We now have working values for deviates, and weights, sufficiently 
accurate for a final determination of the regression of Legit on geo- 
graphical position. 

The values tabulated in Table III, in accordance with the general 
application of the Method of Maximum Likelihood are 


Maximum xXx+Q oa 


poe: Ox 
Minimum xX —fP 5P 


Weighting coefficient a SS 
FO NOK) 2 
where P, Q stand for the probabilities corresponding to the provisional 
value X. 

Using the analysis in this form, if s samples have been observed, with 
a sufficient number of both allelomorphic genes in each, the minimised 
value of S{w(z — X)’} may be taken as x” with (s — 3) degrees of free- 
dom to test the goodness of fit of the hypothesis. In all respects the 
analogy with probit analysis is close. 

The determination of the distance a provides the ratio of the diffusion 
coefficient k to the selective gradient. Since diffusive activity can some- 
times be measured independently, the way is opened for the discussion, 
subject of course to complicating factors, of the selective gradient. 
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PROBLEMS IN THE ANALYSIS OF GROWTH AND 
WEAR CURVES 


Gl bo Ry Box 


Imperial Chemical Industries Limited 
Dyestuffs Division Headquarters 
Blackley, Manchester, England 


1. INTRODUCTION 


I A NuMBER of different fields of application, the problem arises of 
comparing sets of growth and wear curves. The object of this paper 
is to describe methods of analysis which have been found useful, to point 
out what assumptions are being made, and show how these assumptions 
can themselves be put to the test. 


1.1 Examples of wear and growth curves. 


Much research is carried on by technologists with the object of im- 
proving the abrasion resistance of materials, and various machines have 
been devised to test this property. In most of these, specimens of mate- 
rials to be compared are rubbed against a standard abrasive under stan- 
dard conditions and the loss in weight or decrease in thickness of each of 
the specimens is noted at suitable intervals. For example, Fig. I shows 
the weight loss curves of 24 specimens of coated fabrics tested in 
the Martindale wear tester. The experiment was arranged in the form 
of a2 X 2 X 8 factorial design replicated twice, two different fillers F, 
and F, being tried in three different proportions Q, , Q2 , and Q; with and 
without a surface treatment 7’, and weight losses were recorded after 
1000, 2000, and 3000 revolutions of the machine. 

Further examples of this type of test arose in road trial assessments 
of materials for tire treads (see for example Buist et al., 1950). In one of 
these investigations, for instance, a test vehicle was run with each of its 
tires constructed in 3 segments: 4 compounds A, B, C, and D were tested 


on the four tires of the car in a balanced incomplete block design as 
follows: 


iret Lire 2 Tire 3 Tire 4 
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PERCENTAGE OF FILLER Q 


Q,= 25% Q2=50% Q3= 75% 
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FIGURE I. WEIGHT LOSS CURVES FOR COATED FABRICS 


The wear of the compounds was measured by the decrease in tread depth 
which was observed for each segment of each tire at a number of mile- 
ages. Thus for each compound in each tire, there again resulted, not a 
single result, but a set of results from each of which a wear curve could be 
plotted. 

In biological investigations the growth of an animal or part of an 
animal is often the subject of study; Fig. IJ, for example, shows growth 
curves for 27 rats kept in separate cages. The rats were divided at 
random into 3 groups containing 10, 7, and 10 rats respectively, (the 
second group contains fewer rats than the other two, due to an accident 
at the beginning of the experiment). The first group were kept as a 
control, the second group had thyroxin, and the third group thiouracil 


added to their drinking water. 
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FIGURE II. GROWTH CURVES FOR 27 RATS 


In all the examples, it will be seen that we are concerned with experi- 
ments which may be of a simple or complex character; each observation, 
however, consists not of a single value, but of a set of values recorded at 
intervals of time, from which curves can be plotted. 


2. A SIMPLE ANALYSIS 


We begin by considering the wear data plotted in Fig. I for coated 
fabrics prepared in a number of different ways. With data of this kind 
it has been found to be of value to consider not the wear, after say 1000, 
2000, and 3000 revolutions of the machine, but the wear occurring during 
the first thousand, second thousand, and third thousand revolutions, 
that is to say to consider the first differences of the original data. 
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FIGURE III. ANALYSING FIRST DIFFERENCES OF WEAR DATA 


In Fig. IIIa, Y, , Y. and Y; are the total weight losses for a particular 
specimen at 1000, 2000, and 3000 revolutions of the machine. We consider 
YW, =¥4,42 = Yo— Yi, andy, =), — Yo251,y2 and y; can be regarded 
as measuring the average rates of wear in milligrams per 1000 revolutions 
during the three periods, and 7, the mean as measuring the overall average 
rate. Since 39 is equal to Y; , 7 is proportional to the total wear during 
the experiment. The three periods of wear considered can then formally 
be regarded as a further factor, “periods”, and the curve obtained by 
plotting the differences y; , y2 , ys (Fig. IIb) indicates the approximate 
shape of the wear rate curve. Now whatever other information is re- 
quired from the data it will usually be the case that the overall effects of 
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FIGURE IV. COMPARISON OF CURVES USING AVERAGE RATE AND “SHAPE” 


treatments will be of major interest and these effects can be elucidated 
by analyzing the variate 7; it may be, however, that the treatments have 
effected not only the average rates, but have also influenced the configu- 
ration of the individual period rates about their averages, and such effects 
as this can be regarded as interactions between the factor concerned and 
“neriods’’. 

If (Fig. IV) a factor affects only the average wear rate 9, i.e. alters 
Yi» Y2, and ys , equally, (and there is consequently no interaction with 
“periods”’), we shall say that the wear rate curve has been altered only 
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in level, but if the deviations y, — 9, ys — J, ys — gy are affected, we shall 
say that the wear rate curve is also altered in shape. This use of the 
average level 7 and the deviations y, — 9, y2 — 9, ys; — g, to describe 
the curve is analogous to the size and shape analysis used in discrimina- 
tion problems by Penrose (1947) and Smith (1947). On this definition, 
then, two curves are said to have different shapes when the wear rates 
differ by different amounts at different stages of wear. 

The data for Fig. I, after differences have been taken, are set out in 
Table A. The figures in the table corresponding with periods 1, 2, and 3 
refer to the wear between 0-1000, 1000-2000, 2000-3000 revolutions of 
the machine respectively. 


TABLE A 
WEAR OF COATED FABRICS IN MILLIGRAMS 


Proportion of Filler 


Surface Filler Q: (25%) Q» (50%) Qs (75%) 
Treatment 
Period Period Period 
1 2 3 1 a 3 1 2 3 
Fy (SBE NF OT | Rey Gal abak I xa) P4sy4 OA07/ 
208 188 165 | 241 222 201 | 269 283 191 
To 
F, 239 Ae 100) | 224 123 9 79) e245) 17 100 
[SLO Sale 4 oul come OM 220m l2oN mo 
Fy 155 169 151) 198 187 176 | 285 225° 166 
173 152 141 | 177 196 167 | 229 270 1838 
1 
F. V3 eT le ee idl LL eee OMe LL 
160 82 88 OS Soe Salon OMe On 


2.1 A mathematical model for the experiment. 


The error variances for the data are as follows: 


Revolutions Error Variance Revolutions Error Variance 
0-1000 269 0-1000 269 
0-2000 456 1000-2000 200 


0-3000 935 2000-3000 222 
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A characteristic of the cumulative data is seen to be the increase of the 
error variance as the test proceeds, the variance of the differences how- 
ever, remains stable from period to period. This is to be expected, for 
much of the variation probably arises in the operation of the testing 
machine itself and the variation occurring in equal periods of running 
might be expected to be the same. Also, in the original data the errors 
would be expected to be correlated from one observation to the next, 
since for example abnormally low wear occurring in the first 1000 revolu- 
tions would be reflected in subsequent values. So far as the variation of 
the machine was concerned however, correlation between wear in suc- 
cessive periods might be expected to be much smaller and possibly 
negligible. 

For the moment then, we will assume that the departure of y,,; (the 
loss in weight during the 7” period of wear of a sample having the Re 
factor combination) from its mean value 7,; can be represented by two 
independent random variables e, and 6; each being normally distributed 
about zero, the first with variance o; allows for overall variation in mean 
rate in duplicate specimens and the second with variance o¢ allows for 
variations associated with individual periods. 


Ups = ha = GC; = 6; (1) 


If this is true, then the analysis of variance for the data in Table A, will 
be analogous to that for a split-plot agricultural experiment, the “plots” 
being the samples of material and the three values for wear in successive 
periods corresponding to the splitting of the plots. As with split plot 
experiments, the analysis will consist of two parts, each part having its 
own error estimate. This analysis for the wear data is set out in Table B. 
The entries in the table are the mean squares corresponding to the effects; 
the figures in brackets refer to the degrees of freedom available for the 
comparisons. 

The mean squares in the left-hand column are obtained after averag- 
ing over “periods” and they enable hypotheses concerning the average 
wear rate (or what is equivalent, the overall wear) to be tested; the 
correction for the mean, denoted by J, is included for completeness. 
Significance is judged by comparison with the mean square of 312 at the 
foot of this column; this error term has 12 degrees of freedom and is an 
estimate of the “between samples” variance 3c; + o) as is each of the 
mean squares in this column if the treatments are without effect. The 
asterisks indicate significance at the 5, 1 and 0.1% points respectively. 

The mean squares in the right-hand column correspond to interac- 
tions with “periods” and significant interactions imply that a factor has 
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TABLE B 
ANALYSIS OF VARIANCE FOR THE DATA OF TABLE A 


Averaged over “periods” |Interactions with “periods” 


Source (level of rate curve) (Shape of rate curve) 

Mean (1) (1) 1,866,956 (2) 30,479**# 
Main effects 

% Filler (Q) (2) Gaeomaa (4) 440 

Type of Filler (F) (1) LOWER Oates (2) 9,144*** 

Surface Treatment (7) (1) 24,40 4*+* (2) A 2A*** 
Interactions 

OS elt (2) 4,942*** (4) 354 

OE xe ik (2) 397 (4) 172 

FXT (1) 1,682* (2) 1,164*** 

Va Heel (2) 150 (4) 116 
Error (12) 312 (24) 190 


affected the quantities y, — J, y2 — 7, y; — 9, that is, that it has altered 
the “shape” of the rate curve. The interaction of J with the periods 
factor P is P X I = P the main effect for periods, which indicates 
whether the mean rate of growth has remained constant from period to 
period i.e. whether the mean growth curve is a straight line. The error 
mean square of 190 appropriate for testing these effects has 24 degrees of 
freedom and is an estimate of o, the “within samples” variance, as is 
each of the mean squares in this column on the hypothesis that the treat- 
ments are without effect. The entries in this column can be most easily 
calculated by first carrying through an analysis of variance for each 
period separately; and then using the identity; 


Sum of squares total of sums sums of squares 
for interaction = of squares for — <for average 
with periods individual periods ‘effects. 


For example, for the surface treatment 7 the sums of squares for the 
three periods of wear were found to be 26,268, 5,017 and 1,457 respec- 
tively; the sum of squares for the average effect was 24,494, and the sum 
of squares for interaction with periods was therefore 26,268 +- 5,017 ++ 
1,457 — 24,494 = 8,248 and the mean square, 4,124 as shown in the 
table; all the entries in this column including, of course, the error term, 
are calculated in this way. This procedure can be followed whether the 
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remaining effects are orthogonal or not. For example, in the balanced 
incomplete block design used for the assessment of tire treads, the usual 
(nonorthogonal) analysis for incomplete block designs is first carried 
through for the means, averaging over periods; this analysis is then 
repeated for each period separately and the above identity used to deter- 
mine the interactions with periods. 


2.2 Interpretation of the analysis. 


Considering first the left-hand column of table B, we see that all the 
main effects are highly significant and that interactions exist between Q 
and F, that is, between the proportion of filler and the type of filler used 
and between F and T’, the type of filler and the surface treatment. The ap- 
propriate tables of mean values showing the nature of these interactions 
follow: 


% FILLER (Q) 


25 50 75 
Type of Py 169 199 231 
Filler Fy PAL 120 126 


SURFACE TREATMENT 


To Ti 
Type of Fy, 214 145 
Filler F; 186 99 


From the first table, we see that the average rate of wear is less with the 
second filler, and this average rate was virtually unaffected by the in- 
crease in the percentage of filler, whereas with the first filler, the material 
wears more, and the wear increases as the percentage is increased. From 
the second table of means we see that the beneficial effect of the surface 
treatment is even more pronounced with the second than with the first 
filler. 

So far, we have considered the effect of factors only on the average 
rate of wear, we now need to consider whether these effects change at 
different, stages of wear; that is to say whether the factors affect the 
shape of the rate curves. To do this, we consider the mean square for 
the interaction of each of the effects with periods, shown in the right-hand 
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column of the table; the significance of these items is judged by com- 
parison with the error term at the foot of this column. The % filler (Q) 
and % filler X type of filler (QF) effects have no significant interactions 
with periods, so we can regard our conclusions for these effects as prob- 
ably true at all stages of wear; however both F (the type of filler) and 7 
(the surface treatment) show strong interactions. The tables of mean 
values are as follows: 


Period 1 Period 2 Period 3 
Type of Filler Fy 215 213 172 
Fy 181 104 82 

Period 1 Period 2 Period 3 
Surface Treatment To 231 IL} 134 
T 165 144 119 


From the first table we conclude that not only do the samples having 
filler (1) wear at a greater rate than those having filler (2), but also the 
fall off in wear is greater with filler (2). From the second table we conclude 
that although the surface treatment has a favorable effect at all stages of 
wear this is (as would be expected) most marked initially. Finally, we 
see that the interaction F * 7’, between type of filler and surface treat- 
ment, interacts with periods and, on consulting a table of mean values, 
this is seen to be due to the fact that the interaction between filler and 
surface treatment found before, is confined to the first period of wear 
alone. 

The conclusions from the experiment can therefore be set out as 
follows: 


1. Filler (2) results in less wear than filler (1), the rate of fall off of 
wear is greater and the protective effect of surface treatment is more 
marked with (2) than with (1). 

2. Whereas increasing the % of filler (1) results in increased rate of 
wear, the % of filler (2) can be increased, at least to 75%, without 
increasing wear. 

3. The surface treatment markedly reduces wear especially during 
the early stages and when filler (2) is used. 

It is clear that the two fillers are behaving differently and in a full 
analysis the data would be split into two, and an analysis made for each 
filler separately. We shall not however elaborate the analysis further 
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here, since our purpose is merely to show that when the set-up given in 
equation (1) ean be regarded as valid, an exceedingly simple and informa- 
tive analysis can be made. We now proceed to show how it is possible to 
test whether significant departure from the simple set-up occurs or not. 


3, A TEST FOR DEPARTURE FROM THE SIMPLE MODEL 
Instead of equation (1) let us write 

ics mm a tcmeeets (2) 
Then if the simple set-up is valid 

Zi =e + 4b; (3) 
and z,; would be distributed in a three-variate multinormal distribution 
with each variance equal to o; -+ o and each covariance equal to oj . 
(For simplicity the test is illustrated for three variates; it can of course 
be immediately generalized to the p-variate case.) To check the validity 
of our analysis therefore we must test the hypothesis, that all the vari- 


ances are equal and all the covariances are equal; that is, that V*, the 
matrix of variances and covariances is of the form: 


a d d 
Vo = Id a d (4) 
d d a 


against the alternative that the variances are not all the same and the 
covariances not all the same; that is, that the variance covariance matrix 
is of the form: 


a d e 
Va= 1d b i (5) 
Le F c 


where a, b, c are not all equal and d, e, f, are not all equal. 

The null hypothesis of (4) is a little more general than that implied 
by equation (3) for negative values of the covariance d are possible with 
(4) (although since V,) must be positive definite d cannot be less than 
—a/(p — 1)), whereas correlation arising from a common component 
e, in (1) must clearly be positive. However, an analysis of the type given 
in Table B is valid for any positive definite matrix of form (4) so that 
this extension is appropriate. 


3.1 The Test Criterion 


A criterion for testing a statistical hypothesis of this form has been 


*We tacitly assume here that the variance covariance matrix V remains constant from group to 
group, that is to say is itself unaffected by the treatments; we consider this assumption later in § 7 
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obtained by Wilks (1946) using the likelihood ratio method of Neyman 
and Pearson (1928). Let ¢;; = c;; denote the error sums of squares and 
products calculated from the sample for the 7‘ and 7“ variates, then 
the criterion is 


Cy Cie C13 
C21 C20 C23 
A C: C32 C33 
i = 31 (6) 
Aa ee 2 . 
Cit Ci; Ci; 
C3; Cis Ci; 
Ci; Ci; Cii 


where ¢;; is the average sum of squares (¢,; + Cs. + ¢33)/3 or in general 
ox ¢:;)/p and é;; 1s the average sum of products (C12 + ¢13 + C23) /3, or 


in general 
{EZ eut/{ane - 9) 


and p is the number of variates (3 in this case). The value of the 
determinant A, in the denominator can be easily shown to be equal to 
[2., + (» — Ve, J[é:;; — @;)’~' which simplifies the calculations. 

For the wear test example the sums of squares and products for error 
can be most easily calculated from the differences between duplicate 
observations in table A. These differences are set out in table C, for 
example, 14 = 208 — 194, — 4 = 188 — 192, etc. 


TABLE C 
DIFFERENCES BETWEEN DUPLICATES 


A ie 
Fy F, FP, F, 
Period 
Q1 Qe Qs; Qi Qe Qs Qi Qs Qs Q: Qe Qs 
i 14 8 4) —52 19 —17 18 —21 —6 | 23 —31 —23 
2 —4°h 931 | —22 0 8 | —17 9 45 0 —5 29 
3 24 30 —16 —5 31 —25 | —10 -—-9 17] 6 —380 —24 


Total S14 elo a OU oe —9) —21)) 56) 29 —66) —18 
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The sums of squares and products are then obtained as follows: 


Period 
1 2 3 S 
1 3225.0 —80.5 1656.5 4801.0 
Period 2 —80.5 2405.5 —112.0 2213.0 
3 1656.5 —112.0 2662.5 4207 .0 


For example 3225.0 = [147 + 8? + 47+ --- + (—23)7]/2 
50 5 Saf itse (Aes ee ee eo 


The divisor 2 is employed since the values concerned are differences be- 
tween two observations. The check column S shows the sum of products 
between each of the variates and the column totals of table C; this sup- 
plies an independent check on the working, for example, for the second 
row of the matrix 


—80.5 -- 2405.5 — 112.0 = 2213.0. 


The value of the determinant of this matrix which is the numerator 
A, of the criterion is found to be 14,026 & 10°. To calculate the denom- 
inator A, of the criterion, we find: 


Ci == 2764.3, Ci; 488.0, 


€;; + 2¢;; = 3740.3 €;; — €;; = 2276.3 
and A, = 3740.3 X (2276.3)” = 19,381 X 10°, whence A = 0.7237 


8.2 The test of significance 


We now wish to test whether or not this value of A is exceptionally 
small. The exact distribution is not known in the general case; however, 
an expression for the moments of A has been given by Wilks (1946) and 
for these, sufficiently accurate approximations can be calculated. The 
present author (Box 1949) has given a general distribution theory for a 
very wide class of what may be called “A” statistics, whose moments 
can be written in the form 


\Hom] 7 


j=1 a 


tes: | 


(aul 7 


, n(l +2) + &)] 
E(A*)"” = constant - 


[T{ 
(7) 
[Pty + h) + a3] 


k 
=1 
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Given the value of k, m, and the x; , £;, y; and »;, general formulae are 
provided from which taking 1M = 2a log, A7' as a working statistic, an 
accurate x” series solution can be obtained, and simple x” and F approxi- 
mations. For the statistic here considered, Wilks’ expression for the 


moments can be written 
= pv Z 
| ii Ee (+h) — S| 
E(A’”’)" = constant - (p — 1)h@°?" = 


nt (p—- )A+ n} 


(8) 


v being the degrees of freedom of the sums of squares and products tested. 
This is seen to be of the same form as (7) so the general theory can be 
applied. 
Making the substitutions we find we should take for our working 
statistic 
Map low eA 


The more the data depart from the simple set-up, the smaller will be A 
and the greater the value of 17. To test whether I is large enough to 
indicate a “significant”? departure from the simple set-up we calculate 


Shea 5 | {p(p + 1)*(2p — 3)} 
fii=@mt+p 4)/2, A, = {6v(p — 1) (p+ p — 4)} 


and refer (1 — A,) M to tables of x* with f; degrees of freedom. An 
approximation which is rather more precise especially when p is large 
and/or v is small is supplied by calculating 


eee ee i es 
Grappa et A AY PS Ape ie 
and referring //b to tables of the F distribution with f, and f, degrees of 
freedom. 

In the present example v = 12 and p = 3. Whence f, = 4, 
A, = 0.125, A, = 0.0174, M = 12 log, (1/0.7237) = 3.880. 
(1 — A,) M = 3.395 and this quantity is to be referred to tables of x? 
with four degrees of freedom, from which we can conclude at once that 
on this data there is no reason to question the simple set-up. The actual 
probability given by this approximation for the chance occurrence of a 
value of M as great or greater than this is slightly less than 0.5. Using 
the F approximation a very similar result would have been obtained, we 


find 


A; 


f. = 4, foi= 13406, b = 4.578. 
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Thus M/b = 0.8476 is to be referred to tables of F with 4 and 3456 
degrees of freedom, and consulting the table of Thompson and Merring- 
ton (1943) we again find a value for the probability of chance occurrence 
slightly below 0.5. In this particular case both approximations are quite 
accurate, and the values they give are almost identical. When p is larger 
and v is smaller the x” approximation is less accurate and the F approxi- 
mation differs more markedly from it, f2 being no longer very large as it is 
in this example. 


4, AN ALTERNATIVE SET-UP 


We have seen how, by the device of taking differences, the problem of 
interpreting wear data was facilitated and a simple analysis was possible 
if it was reasonable to assume a particular set-up. We have shown that 
for a particular example the hypothesis that the set-up was of this simple 
form was not contradicted by the data. 

The simple set-up would be expected to represent wear data satis- 
factorily if most of the variation arose from the operation of the machine 
itself or if the variation within replicate specimens of material were 
mainly confined to changes in average abrasion resistance and not to 
changes in ‘‘shape”’ of the wear curves which might give rise to serial 
correlation between differences. Observational errors would also tend 
to cause departures from the set-up, for an apparent increase in wear 
rate during one period would be compensated by an apparent decrease in 
the next, and this would lead to negative correlation between successive 
differences. In some cases therefore we would not expect the variances 
and covariances, even after differencing of the data, to be capable of ade- 
quate representation by the simple pattern of equation (4) and the more 
general set-up typified by equation (5) would have to be adopted. 

When a research program is being carried out in which the results 
will appear in the form of wear curves or growth curves, it is worthwhile 
paying particular attention, in the preliminary experiments, to the form 
of the variance co-variance matrices, so that decisions may be reached 
concerning a set-up, and method of analysis, suitable for use in this 
particular investigation; that is to say with this particular type of mate- 
rial and interval between observations. Consider now the rat growth 
data shown in detail in Table D at end of article, which was plotted in 
Figure II. For the reasons given above we should not expect the 
weight gains for these animals, even after differencing, to be uncorrelated 
from one period to another. In fact, if we denote the five variates record- 
ing initial weight and weight after one, two, three, and four weeks by 
Yo, Y:1, Y2, Y3, Y, and the differences, Y, — dre Case ree Neto oe 
Ys — Ys by y:, Yo, Ys, Ys, the matrix of sums of squares and products 
for the 24 error degrees of freedom for y; , y2 , y3 and y, , 1s found to be 
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[ 582.3 42.5 —55.5 —74.6 
42.5 609.0 626.5 344.5 


(9) 
—595.5 626.5 1046.7 459.0 


—74.6 344.5 459.0 853.04 
From which proceeding as before we find 
A= (3534, M250); i — A, = 0.9277, j= 3s 


Referring (1 — A,)M = 23.2 to tables of x? with 8 degrees of freedom 
we conclude that the probability of a chance deviation from the simple 
set-up as great as this is less than 0.01; a similar result is given by the F 
approximation and we are therefore led to reject this set-up. 

Although differencing is not completely successful in transforming the 
data into a form in which the variances are equal and the covariances are 
equal, it is worth noting that the differences do show a great deal more 
uniformity in this respect than the data before differencing. The corre- 
sponding error matrix for sums of squares and products for the overall 
Weta) po) ge a — You and. y, — 9) ois 


bags 624.8 569.3 494.7 


624.8 1276.3 1847. 2117.2 
(10) 
569.3 1847.3. 3465.0 = 4193.9 


494.7 2117.2 4193.9 5775.8 


and the value of x” obtained on applying the test to these values is 109.1; 
the transformation has thus gone a good deal of the way towards bringing 
the data to the simpler form. 

In making tests of an actual set-up, it should be borne in mind that 
the important consideration is how far departures from the assumptions 
made will affect the tests based on these assumptions. This problem has 
been investigated in a number of cases by the present author and it is 
hoped to publish the results elsewhere in the near future. It appears 
that minor departures of the data from independence and homoscedas- 
ticity of the type considered here will not seriously influence subsequent 
tests of significance; a similar conclusion was reached by Daniels (1988). 
Thus, in the wear curve example we found no significant departure from 
the simple set-up, and although this did not mean that no such depar- 
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ture could have occurred, but possibly, merely that the data were not 
sufficiently extensive for it to be detected, it is probable that little error 
was made by adopting the simple set-up in this case. In the growth curve 
example however a marked departure is apparent and it would be safer 
to adopt the less restrictive assumptions of the alternative hypothesis 
of equation (5). 

We shall assume that the variates Y) , Y: , Yo, Y3 and Y, are dis- 
tributed about their mean values in a 5-variate normal distribution, the 
same for each rat, and this of course implies that any set of variates 
derived from these, by linear transformation, will also be distributed 
multinormally; in particular the differences will be distributed in that 
form. 


4.1 The Multivariate Test 


Now if a single variate only, say the overall increase in weight, were 
being analyzed, the hypothesis concerning the significance of treatment 
differences could be tested by means of the analysis of variance, that is to 
say the criterion 


mean square for treatments 


mean square for error 


would be referred to tables of the F distribution with the appropriate 
numbers of degrees of freedom. Alternatively (see for example Kolod- 
ziejczyk 1935) the criterion* 

ie sum of squares for error 


sum of squares for error + sum of squares for treatment 


could be employed, and the test carried out by referring to tables of the 
incomplete B-function (Karl Pearson; 1934, Thomson; 1941), the result 
of course would be precisely the same. 

For our present purpose the latter criterion is of more interest, 
because it can be directly generalized (Wilks; 1932, Pearson and Wilks; 
1933, Bartlett; 1934, 1938) to the case where the observations are not 
single variates but multivariates, whereas the former criterion cannot. 
Thus the hypothesis that the mean value for each of the variates is the 
same from group to group; (for example, that the gains in weight during 
the first week are all equal, and the gains during the second week are all 
equal, etc.) can be tested by calculating the criterion; 


*A is used in the paper to denote a criterion of the form associated with the likelihood ratio method 
of Neyman and Pearson. M is used to denote a logarithmic statistic derived from A. The likelihood 


statistic A and the derived quantity M referred to in this section are of course different from the 
criterion discussed in § 3. 
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i | sums of squares and products for error | 


sums of squares and products for error 
+ sums of squares and products for treatment 


where determinants whose elements are sums of squares and products 
replace the single sums of squares of the univariate criterion. 

Thus, had we desired to use the more general set-up in the wear test 
example, an overall test for each of the main effects and interactions 
could have been applied by calculating the 3 X 3 matrix of sums of 
squares and products first for error and then for the particular main 
effect or interaction concerned, and hence calculating the criterion A. 
This test would not have distinguished between changes in average and 
changes in shape but would have been an overall test including both. 

The exact distribution of A is known only for certain special cases, 
however, this is another of the general class of statistics whose moments 
can be written in the form of equation (7), and simple approximations 
which are perfectly general and which are usually sufficient for most 
practical purposes can be obtained. To preserve generality, even when 
the exact distribution is available, these approximations will be used in 
all the tests that follow. If is the number of degrees of freedom for 
treatments plus error, g the number of degrees of freedom for treatments 
and p the number of variates then Bartlett’s (1938) x” approximation 
is obtained by calculating 


M=nlog,A* A, =(P+q+1)/2n fi=p¢q 
and referring (1 — A,)M to tables of x” with f, degrees of freedom. This 
approximation tends to break down if n is small or p and q are large and 


in these cases it is worthwhile calculating the more accurate /’ approxi- 
mation (Box 1949). For this we calculate in addition 


f 12n*(pq + 2) Fa iment 
ee hig re Ve Apa iil fe, 


and refer M/b to tables of F with f, and f, degrees of freedom. 

In the growth curve example if we consider the variates y; , Yo, Ys» Ya 
(that is, the first differences of the weight gains) the matrix for sums of 
squares and products for treatments is found to be 


S17 37.2 11.5 112.9 


37.2 476.9 (Pe 787.4 
(11) 
11.5 782.7 1315.9 1260.1 


112.9 787.4 1260.1 1334.04 
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The corresponding matrix for sums of squares and products for error has 
already been given (9). The error plus treatment matrix is obtained by 
adding each element in the error matrix to the corresponding element in 
the treatment matrix. The ratio A of the error determinant to the error 
plus treatment determinant is then found to be 0.2661, and n = 26, 
p = 4,q = 2. For such large values of n and comparatively small values 
of p and q Bartlett’s x” approximation will be adequate and we find 


M=344, A>=7/52, f=8 


and referring (1 — A,)M = 29.8 to tables of x” with 8 degrees of freedom 
we conclude that the mean values for y; , 72 , y3 , and ys representing the 
growth during the first, second, third, and fourth weeks differ very sig- 
nificantly from group te group (P < 0.001). 


4.2 Special Properties of the Criterion. 


Before proceeding further we note certain important properties of this 
criterion used in the multivariate extension of the analysis of variance. 

1. The criterion is invariant under non-singular linear transformation 
of the variates. Thus, in the example above, if we had analyzed the total 
gains in weight instead of the differences, or had applied any other linear 
transformation of this sort to the data, the value of the overall criterion 
would have been unchanged. 

2. The sums of squares and products matrix for any new set of 
variates obtained by linear transformation can be found directly by 
applying the transformation to the rows and columns of the matrix of 
sums of squares and products of the old set of variates. For example if 
the matrix (10) for total weight gains were known, (9) the corresponding 
matrix after differencing the data, could be obtained by applying the 
differencing process to the rows and columns of (10) itself; it is not neces- 
sary to make the transformation to the original data and recalculate. 

3. In the calculation of determinants, the method of pivotal conden- 
sation (see for example Aitken, 1948) provides a rapid practical proce- 
dure; thas device also provides a useful method for the elimination of 
varvables. As an example consider a determinant A of sums of squares 
and products for, say, three variates y, , Yo , Ys , 


Cu Cie C13 


SS C21 Co9 C23 where Ci; == (Gis 
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dividing through the first row by c,, we obtain a new first row 


if this is subtracted c,, times from the second row and ¢,, times from the 
third, we have 


1 Cie Cis 
C1 Ci 
Cy C14C 
A ep es te pes aE 

C11 Ci 
C90 Cc, 
12C13 13 

0 C23 —_ Cy aa 
Ci Ci 


and writing Co: — Ci2/Ci1 AS Co2.1 , Cos — Cr2C13/Ci1 , AS Coz., , etc. and ex- 
panding the determinant along the first column, we have 


€22.1 €23.1 


A= Cy 


that is 
A = Nae = C11 Aos.1 . 


As is well known, to compute the value of any p X p determinant, 
the process may be repeated p — | times till the determinant is reduced 
to the product of p known quantities, and this process is the basis of the 
Gauss-Doolittle method for the solution of the linear equations, and can 
be still further simplified (see for example Dwyer; 1942). What is inter- 
esting for our purpose is the fact that the elements of A,;., are the sums 
of squares and products for y, and y, after eliminating the variable y, , 
that is tosay they are thesums of squares and products of deviations from 
the regressions of y. and y; on y,.. Now if condensation of this sort is 
applied simultaneously to numerator and denominator of A we have 


Cy, (error) Bon.g (error) 
C,, (error + treatments) Ao3.1 (error + treatments) 


Ke 


=A 


In the above equation A, corresponds to a univariate analysis of vari- 
ance for the variable y; and the second component to a multivariate 
analysis of covariance for the remaining variables with the first variate 
y, eliminated. Any number of variables can be eliminated in this way, 
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the number of degrees of freedom for error being correspondingly reduced 
after each elimination. A successive elimination of variates of this sort 
was applied by Bartlett to the linear quadratic and cubic components 
fitted to the growth curves of pigs by Wishart (1939). 


4.8 Further Analysis of the Data. 


Now even though the taking of differences does not result in a simpli- 
fication of the set-up, it allows the changes in the wear curves to be more 
easily appreciated and may still be employed in the interpretation of the 
overall criterion. We shall therefore again consider the mean growth 
rate 7 and the deviations from the mean y,; — g, etc. Only three of the 
four deviations from the mean are linearly independent and all the infor- 
mation concerning departures from the mean is contained in any three of 
them, we therefore consider the variates 7, y1 — 9, Ye — y and y3 — 9; 
Ys — 7 is omitted from the analysis, (exactly the same result will be ob- 
tained whichever of the deviations is omitted). Using the second property 
noted above, the entries for sums of squares and products for the new 
variates are obtained by direct transformation. For example we obtain 
the error matrix for the new variates from the error matrix (9) for 
Yi,» Yo, Ys , and y, as follows; first applying the transformation to the 
rows, corresponding to the operation of taking the mean ¥ we replace the 
elements of the first row of (9) by their column means, the second row is 
then obtained by subtracting these values from the elements of the first 
row of (9) corresponding to the operation of taking y, — 9; the third and 
fourth rows are found similarly, and the whole set of operations is then 
carried out on the columns. A partial check is supplied by the symmetry 
of the final transformed matrix and a complete check can be made by 
calculating the sums for each row and column of the final matrix and 
confirming that these totals agree with the values found by operating on 
the sums of rows and columns of the original matrix. From the error 
matrix (9) we obtain 


7] hy YY Oe 0 

7 361.0 —237.3 44.6 158.2 
y— 9 —237.3 695.9 —125.8 —337.4 
Yo — ¥ 44.6 —125.8 158.7 62.7 
Ys — ¥ Wye) — 337.4 6250 369.3 


and applying the same procedure to the error plus treatment matrix we 
have 
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y a7) Yy2 — ¥ tp = J] 

7] 935-5 —ol.0 —8.8 426.2 
Ok = 0 —751.0 1230.5 —96.0 —654.7 
yp — 9 eave ~96.0 168.0 56.3 
ia 426.2 ~654.7 56.3 574.6 


The A criterion for means alone is therefore: 


2 360.9 
A(y) = 93547 0.3859 

and for reasons already given we shall employ Bartlett’s approximation 
to make the test of significance. We find (1 — A,)M = 22.9, should be 
referred to x tables with two degrees of freedom whence we deduce that 
the mean growth rates differ very significantly (P < .001) from group to 
group. To test the deviations from the means, that is to test whether the 
“shape” of the growth curve varies from group to group we calculate the 
ratio of the 3 x 3 determinant for error to that for error + treatments for 
the three variates y; — J, Y2 — 9, ys — 9. We find 


AG — 9, Yo — J, Ys — 9) = 0.4366 


and (1 — A,)M = 19.0 is referred to tables of x” with 6 degrees of 
freedom. This value is significant (P < .01) and we therefore conclude 
that, not only the mean level, but also the shape of the curve is changing 
from group to group. A table of mean values indicates the nature of the 
differences. 


MEAN GAINS IN WEIGHT (GRAMS) 


Group 
Period 

1 2 3 

Ist week 24.5 20.3 21. 
2nd week Pah 15) 29.0 19.5 
3rd week 24.1 29.3 12,4 
4th week 30.5 30.1 15.8 
Mean rate (grams/week) 26.7 PLP i 8 


Further tests show that no significant differences occur between 
groups | and 2, i.e., that the treatment of group 2 is without significant 
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effect, however group 3 differs from the other groups both in average 
level and in shape. In the first two groups we find a fairly steady rate, 
which if anything, is tending to increase, whereas a fall in growth rate is 
found in the third group. 

So far the average effects and “shape” effects have been treated 
separately, but it may be relevant to inquire whether the effects found in 
the two parts of the analysis can be regarded as separate entities, or 
whether they are really manifestations of the same thing. In Fig. IT it is 
noticeable that the growth curves of group 3 not only show a low average 
rate, but also tend to be convex upwards whereas the growth curves of 
groups | and 2 have a higher average and are if anything concave. Now 
there may also be a tendency within the groups, for these curves with 
low average rates of growth to be also those which are most convex; we 
may therefore wish to test whether given the change in mean growth rate, 
any differences in ‘‘shape”’ occur, other than would be expected from the 
internal evidence of the groups concerning the relation between ‘‘shape”’ 
and mean value. To make the test we use the third property of the A 
criterion mentioned above; the criterion for variables y, — 7, yo — %, 
Y3 — J given 7 is calculated by dividing the overall criterion for the 4 
variables by that for the single variable 7. 


Ay, =U i Uoeeae i. aura 9:9) a Ay, = Y; Yo — UY; Ys — Y, 9) /AG) 


ma A(y, » Y2, U3, ys) /AQY) 


_ 0.2661 
~ 0.3859 


= 0.6896 


Since one variable g has been eliminated we have n = 25, q =:2, p = 3, 
and (1 — A,)M = 8.18 is referred to tables of x” with 6 degrees of free- 
dom. The probability of chance occurrence of such a value is about 0.25. 
We see, therefore, that there is no evidence of differences in shape other 
than would be expected from the internal relation between average and 
shape. 


5. REDUCTION OF THE DATA 


In some experiments, weighings are made at very short intervals of 
time, and the number of points p’ for each growth curve is large. Usu- 
ally however the salient features of the curves will be described by em- 
ploying fewer than p’ constants. Thus to reduce his data Wishart 
(1988) fitted orthogonal polynomials up to the third degree to the overall 
weight gain for each of a number of pigs receiving different rations, and 
analyzed the regression constants. The essential idea is to reduce the 
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data without sacrificing the extra precision given by the larger number 
of points available. When the method of analysis given here is to be 
used, this can be done by first applying some process of graduation, to 
produce a smooth curve through each set of points corresponding to each 
animal, and analyzing the smoothed values read off from the curves, at a 
number of equal intervals sufficient to give an adequate description of 
the curves. This graduation of the data can sometimes be accomplished 
quite satisfactorily by fitting the curves by eye, but some may prefer a 
method which is more objective. Since any polynomial of degree p is 
uniquely determined by specifying p + 1 points through which it passes, 
the division of the smoothed curve into p periods, specified by p + 1 
points, is equivalent to the description of the curve by a polynomial of 
degree p. In the growth experiment described here, two weighings were 
made per week, and the values actually plotted in Fig. II and analyzed, 
are the means of these pairs of values. 


6. ELIMINATION OF THE INITIAL WEIGHT 


In the analysis of growth curves the increases in weight of the animals 
may be correlated with their initial weights. In this case greater 
precision may be obtained if the analysis is made after elimination of the 
initial weight by covariance analysis (see for example Fisher 1941). The 
elimination of y, , the initial weight, can be accomplished in a precisely 
similar manner to that used for the elimination of 7 from the criterion for 
“shape” analysis of 4.3, that is to say we have for the overall criterion 
after the elimination of y, 


Ajo34.0 = Aoro34/ Ao 


This criterion serves to assess the differences in growth rates during the 
four periods, after the regression of each of these variates on the initial 
weight has been allowed for, and its significance is assessed as before, the 
degrees of freedom for error being one less than for the corresponding cri- 
terion A,.3,. Weshall normally wish to analyze Ajoa4.o further, however, 
and to do this we shall need the corresponding matrices of sums of squares 
and products. These can be found in the manner described in §4.2. The 
matrices for error and for error plus treatments for the five variates Yo , 
Yr, Yo» Yz and y, are reduced by a single pivotal condensation based on 
the element corresponding to the sum of squares for y) . This gives the 
desired matrices for the numerator and denominator of Ajo34.0- Further 
analysis of the data into differences in mean growth rate and differences 
in “shape” can be accomplished by operating on the determinants of 
Ajoga.9 in precisely the same manner as has already been described for 


Ajo34 o 
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The two components A(g:yo) and A(y: — 9, Y2 — J, Ys — G+ Yo) 
assess respectively, the change in overall growth rate when change in 
initial weight is allowed for, and the change in shape when change in 
initial weight is allowed for; again apart from the loss of a degree of free- 
dom the tests are the same. 

Finally A(y, — 9, Yo — 9, Ys — 7:Yo, J) can be calculated by elimi- 
nating J in a precisely similar way as before and this criterion will assess 
whether group differences occur other than can be explained by the rela- 
tion within the groups between the ‘‘shape” and the initial weight and 
average growth rate. 


7. TESTING AN ASSUMPTION IN THE MULTIVARIATE ANALYSIS 


Just as in a single-variate analysis of variance the assumption is 
usually made that the observations are normally distributed about their 
population mean values with constant variance so an analogous assump- 
tion that the variates are multinormally distributed about their mean 
values with constant variance-covariance matrix is made in the multi- 
variate analysis of variance of §4.1. If the variance-covariance pattern 
changes markedly from group to group, this test may be invalidated. 
Also in the test of §3.1 concerning the form of the variance-covariance 
matrix, the sums of squares and products are pooled on the tacit assump- 
tion that the variances and covariances do not change from one treat- 
ment group to the next. If this were not so an averaging effect might 
occur so that even though individual groups showed departure from the 
simple set-up, the overall criterion computed from the pooled error sums 
of squares and products for all the groups, might show no such departure. 

To test the assumption that the matrix of variances and covariances 
remains constant from one treatment group to the next, the present 
author (Box 1949) has employed the multivariate analogue of Bartlett’s 
(1937) criterion which is used to test for constancy of variance in the 
univariate case. 

We take as our criterion 


M = N log. | si | — 2 log. | Sijz |) 


where s,;; is the usual unbiased estimate of variance or covariance be- 
tween the 7-th and j-th variable in the -th sample based on sums of 
squares and products having v, degrees of freedom and there are k such 
samples, s;; is the average variance or covariance (>>, v; s,;,;)/N and 
N= 7; v, the total of the degrees of freedom. It will be noted that, as 
usual, the determinants of variances and covariances replace the single 
variances of the univariate criterion. It is perhaps worth noting that 
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again this criterion is invariant under linear transformation of the dat a, 
that is to say data which show lack of const: ancy in variance and covari- 
ance cannot be made more homogeneous by linear transformation. 

The test will be illustrated for the growth data of rats set out in 
Table D for the variates y, , y2, y; and y,, recording increases in weight 
in four successive weekly periods. 

The individual matrices for sums of squares and products are as 
follows: 


GROUP I GROUP II 


2D eae to 18.5 f111.4 83.0 78.4 39.7] 


13.5 202.5 224.5 110.5 83.0 246.0 292.0 157.0 


| =7.0 224.5 510.9 1175 78.4 292.0 473.4 264.7 


lod 1 17. 258.52 L 39.7 157.0 264.7 174.9 


GROUP III 


| 260.4 —54.0 —126.4 —100.8 


—54.0 160.5 110.0 77.0 


—126.4 110.0 262.4 76.8 


L —100.8 77.0 76.8 419.6 
ibe, == 1) 


Since | s;;. | = | ¢:;: |/v7 the determinants of the variance-covariance 
matrices can be obtained directly from the determinants for the sums of 
squares and products and we find 


log, | 8:41 | = 11.2700, log, | s:;2 | = 10.8357, log. 


the determinant for the average variances and covariances is found in a 
similar way from the total sums of squares and products matrix (9); 


log. | s:; | = 12.4478 


and M = 24 X 12.4473 — 9 X 11.2700 — 6 X 10.8357 — 9 X 12.7008 = 
17.9838. This logarithmic statistic M is a further example of the class 
discussed in §3.2, and approximations have been derived using the general 


theory referred to before. 


8:73 | = 12.7008 
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For the x” approximation the following quantities are calculated 


ee oe eee 
APS G@eE EIN An) 

and (1 — A,)M is distributed as x” with f, degrees of freedom. As 
before, a more precise approximation, which is useful when some of the 
degrees of freedom y, are small or p and/or k are large can be obtained 
using tables of F. We calculate 


wip Dose) ie 
BE 6(k — 1) ( Bie +s) 


and refer M//b to tables of F with f, and f, degrees of freedom where 


eee 
eS A. 


fi 

and Cee rays 

In this particular example A, = 0.2408, f, = 20, (1 — A,)M = 13.5 1s 
therefore referred to tables of x” with 20 degrees of freedom. The prob- 
ability for the occurrence of a value as great or greater than this, when 
the variances and covariances are in fact constant from one group to the 
next, is thus about 0.85, and there is therefore no reason to doubt the 
homogeneity of the data in this respect. 

This paper originated partly as the result of a note published by 
O. L. Davies (1947) criticising a method of analysis for growth curves 
proposed by W. S. Weil (1947). 

I am indebted to Dr. Davies for proposing this problem, and to those 
of my colleagues who were responsible for the investigations which are 
mentioned. In conclusion I wish to warmly acknowledge the help and 
guidance I have received from Dr. H. O. Hartley in this work. 


SUMMARY 


In the analysis of growth and wear curves, the effects can often be 
simply interpreted by differencing the original data; these differences 
correspond to the average growth rates during successive periods. If the 
successive periods are treated as the level of a further factor “periods”’, 
the effect of treatments on mean rate is measured by the variation in the 
period averages and on the “shape” of the rate curve by the interaction 
of these treatments with “periods”. The taking of differences sometimes 
results, at least approximately, in a very simple covariance pattern for 
the errors, and the analysis can then be made by a simple application of 
the technique of the analysis of variance. A test is given which makes it 
possible to decide whether this simple set-up is contradicted by the data. 
When the simple set-up is not appropriate, a multivariate extension of 
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the analysis of variance is used to make the tests. 
properties of the criterion are discussed which facilitate the analysis and 
the elimination of variables such as initial weight. Finally, it is shown 
how an important assumption made in the multivariate analysis may be 


tested. 


Buist, J. M., Newton, R. G., and Thornley, E. R. Trans. I. R. I. (In the press). 
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INITIAL WEIGHT AND WEEKLY GAINS IN WEIGHT FOR 27 RATS 


TABLE D 


Group 1. Control 


Group 2. Thyroxin 


Group 3. Thiouracil 


Rat yo| w| ye | ys | ys | Rat | yo | ys | ye | ys | ys | Rat | yo | yr | yr | ye yA 
1 57 | 29\ | 28 | 25 | 33 ti 59 | 26 | 36 | 35 | 35 18 61 e2Zo i 2a aL 9 
2 60 | 33-| 30 | 23 | 31 12 Ba 7) 29) 20) | 28. 19 59 | 21 | 21 10 11 
3 52: | 25 | 34 | 33 | 41 13 56 | 19 | 33 | 43 | 38 20 53: || 26.) 21 6 |) 27 
4 49 | 18 | 83 } 29 | 35 14 59 | 26 | 81 |) 32: || 29 21 59 | 29 | 12 11 11 
5 Bor e2o lear! 76 30) 15 57 | Us | 26 | 28 | 24 22 51 | 24 | 26 | 22 17 
6 46 | 24 | 32 | 29 | 22 16 Ao We | Se) LO) 28 23 Bile eee || tiga 8 | 19 
tl 5120) |) 23 16: 32 L976 52 | 18 | 35 | 33 | 33 24 bb 225) hit 8 6 
8 63) |) 28: | 2h | 183) 24 25 58 | Di | 24 | 21 |) 24 
9 49 | 18 | 23 | 22 | 28 26 AG |lioni| mdrzan|medeezal| liza 

10 57 || 25 | 28 | 29 | 30 27 5S) | LO Laos: 


yo represents initial weight of rat 


yx gain in Ist week 


y2 gain in 2nd week 
ys gain in 3rd week 
ys gain in 4th week 


THE RELATIVE FREQUENCY OF SPARSE CELL ELEMENTS— 
AN APPLICATION TO RETICULOCYTE BLOOD COUNTS 


Marvin SCHNEIDERMAN AND GEORGE BRECHER 


National Institutes of Health, Public Health Service, 
Bethesda, Maryland 


4 Pee PROBLEM of determining the relative frequency of sparse elements 
frequently arises in making blood counts. For example, reticulocytes 
in normal humans comprise about 1% of the total red cells in the blood. 
With certain types of anemia this percentage rises considerably. The 
current, “standard”? method for making reticulocyte counts involves 
counting 1000 red cells, and noting the number of reticulocytes among 
the 1000. This is a relatively time-consuming technique, and to reduce 
the work involved another technique has been suggested. 

The new technique, which we call the Miller technique, involves 
using an ocular disc which is divided into two areas, as in figure 1, below. 


. 


FIGURE 1 
Miller ocular disc, ratio of large area to small area = 9, 


The sparse elements are counted in the large area (the whole square) 
and the major elements (including sparse elements) are counted in the 


small area (the little square). The estimate of p (the proportion of the 
sparse elements) is then: 
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where y = the number of sparse elements counted 
x = the number of major elements counted in the small area 
k = the ratio of the large area to the small area 


The question that then arises is whether this estimate of p can be 
made from the Miller technique with less work (for the same accuracy) 
than for the standard technique. It is the purpose of this note to show 
under what conditions the Miller ocular disc is a labor saving device. 

It is common experience that in blood-element counting problems, 
the various elements appear to be distributed somewhat in accord with 
the Poisson law. We find that this accord is not perfect [1], [2], and, in 
fact, the internal variance may be less than Poisson. However, this 
difference is small, and is in the direction of conservatism. The difference 
from Poisson, if any, will tend to make firmer our estimate of p, using the 
Miller disc. 

The variance of the estimated proportion, #, is given to a first approxi- 
mation by: 


oe i a & o. ear) 
(1) V(p) = 2X? \y? =i 5 ti aie 


where Y and X are the population values for which y and x are sample 
values. 
Making the assumption of a Poisson distribution permits us to replace 


a, by Y and a; by X. If, in addition, we assume a zero correlation,* 
and assume that we use the Miller disc, with k = 9, we get: 


, yf 1% 
®) VO = g(t +z) 
and since 

hPa Sy 
Pp ae OX ) 
(3) V@) = oie (1 + 9p), 


and the expected number of major elements, X, to be counted equals 


ae P 


*In usng the Miller dise (k = 9), experimentally for making reticulocyte counts, a small positive, 
but unimportant, correlation wasfound. N eglecting the correlation will tend to overstate the variance, 
This error, like our assumption of the Poisson distribution, is in the direction of conservatism. ‘The 
correlation becomes more important for values of & closer to unity. 
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To find where the Miller disc is useful, we want the total work of 
counting to be less for the Miller disc than for the standard technique. 
We can set up total work 


(5) W=X + cY 
where: X = the number of major elements to be counted 
Y = the number of sparse elements to be counted 
c = the difficulty of counting a sparse element relative to the 


difficulty of counting a major element 


so that from p = Y/9X and (4) we get 


1 : 
(6) W= TH (14 pe+ p + Sep’) 


Where the elements are of equal difficulty in counting c = 1 and 


P 2 
rf WS a lo 
(7) 9V@ ( P) 
In the standard technique, the variance of # equals p(1 — p)/1000, 
the usual binomial variation. Substituting this for V(#) we have 
1000 2 
8 We (Le 
(8) re a (1 + 9p) 
Since our total work for the standard technique equals 1000(1 + »)** 
cells counted, we may substitute 1000(1 + p) for W. Multiplying both 
sides of (8) by 9(1 — p)/1000 we get 


(8a) 9(1 — p’) = 1 +. 9p)’ 


and we find that for values of p less than .214 the Miller ocular is more 
efficient than the standard technique. 

The relative amount of work for different values of p is given in 
column (2) in Table I. 

The Miller disc is only one of many possible designs. At present the 
Miller disc is available commercially, but there may be more efficient 
designs. To investigate this we should return to equation (6). Replacing 
the 9’s by k we have 


(9) W = TH (i. + pe + p + kp’) 


**For the standard technique the total work W may be considered equal to 1000 or 1006(1 + p) 
according to the mechanical process used in counting. For W = 1000 the Miller ocular is more efficient 
for p less than .189 rather than .214. 
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TABLE I 
RELATIVE WORK USING THE MILLER TECHNIQUE 


Relative Work 


Pp 
Miller disc, Variable ocular, 
ke 9 k = 1/p 

(1) (2) (3) 

.O1 .132 .040 

.02 “155 .080 

05 238 .201 

.10 405 .404 

.15 .628 614 

.20 .907 833 


The relative work multiplied by 1000(1 + 7p) gives 
the total number of cells to count using the Miller 
technique. 


To minimize the total work, we differentiate with respect to k, and 
set the result equal to zero. We find, for a fixed value of V(p), the value 
of k which minimizes the total work is: 


1 
(10) i = 
pve 
where the two elements are of equal difficulty in counting ¢ = 1 and 


k = 1/p. For this arrangement the same number of major and sparse 
elements will be counted. 
Equation (8a) now becomes 


ee 
(11) my 0) = 4 


and for p < .236 the Miller technique (with a variable ocular adjusted 
tok = 1/p) is more efficient than the standard technique. ‘This value of 
» compares with the value of .214 obtained as the “efficiency”’ point 
when k = 9. 

The gain, then, which arises in using a completely variable ocular 
(the Ehrlich ocular, for example) is quite small except for small values 
of p (See column (3), Table I). In addition, variable oculars are difficult 
to set at an exact value of k = 1/p (especially when p is not known)*, so 


*A variable ocular can be approximated roughly by using a hemocytometer and counting a different 
number of squares for the major elements and for the sparse elements. K is then set with some accu- 
racy, and it may be possible to get close to 1/p. 
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that a fixed-ratio ocular disc of the type of the Miller disc can be used 
without much loss. 

Because of the region in which the Miller disc is most useful, we have 
computed fiducial limits for values of p from .01 to .20. Graphs incor- 
porating these tables, and a report of experimental results using the 
Miller dise will be published elsewhere. 
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STATISTICS SUMMER SESSION 1951 


The Institute of Statistics is to hold a special summer session June 11- 
July 19, 1951. It will be for graduate students in statistics and for 
research workers, special emphasis being given to statistics in chemistry. 
Several visiting professors will participate in the lecturing. For details 
write the Institute of Statistics, State College Station, Raleigh, North 
Carolina, 
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ee stupy is based on data made available in an investigation by 
King and Mason (Ref. 1) in which the urinary excretion of cortico- 
steroids was determined for 87 normal children (28 boys, 59 girls) includ- 
ing newly born babies and children up to 16 years of age. On approxi- 
mately the same day as the urine was collected for the determination of 
the corticosteroids, measurements of height and weight without clothes 
were made. Urine was collected during twenty-four hours in glass bottles 
without preservative. The parents and the children were instructed as 
to the necessity of accurate collection of the urine. They were ques- 
tioned afterward and if there was any doubt as to the accuracy of the 
collection, the specimen was discarded. The method for the determina- 
tion of the corticosteroids has been described by Corcoran and Page 
(Ref. 2). The values for the urinary corticosteroids are expressed as 
milligrams of 11-dehydrocorticosterone per twenty-four hours. 

The mean corticosteroid output per twenty-four hours increases 
steadily with age (fig. 1). Since, however, during this period the weight 
and the height are both increasing, it is pertinent to inquire whether the 
increase of output is related to either or both of these, rather than to age 
per se. Talbot (Ref. 3) reported that if the output of corticosteroids is 
expressed in ratio to surface area, the surface area being measured by the 
formula of DuBois (S. A. = 0.00718 W°'*” H°’”*), the output does not 
change with age. This finding we did not confirm in our data. The mean 
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output per twenty-four hours per square meter of body surface (DuBois) 
is shown plotted against age in figure 1. It is seen that there is a sharp 


Excretion of corticosteroids in relation to age 
0.38 
0.36 a. Unadjusted 


0.34 


Corticosteroid output, 
mg per 24hr 


0.10 b. Adjusted for surface area (DuBois) 
0.09 


0.06 
0.05 
0.04 


Corticosteroid output, 
mg. per e4hr per SYM. 


0.01 


c. Adjusted for weight, linear formula 


Oe ee 


Corticosteroid 
outpul, 
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Age, years 


FIGURE 1 


The relation of the mean corticosteroid output to age. a. Unadjusted. b. Adjusted for body surface 
(DuBois for mula). ce. Adjusted for weight, HS § = 0.180 + 0.003 W, where S is the observed output, 
§ is calculated from the linear formula, and W is the observed weight. 


decrease in the first three years of age and a gradual decline thereafter. 
However in this calculation we are of course not measuring surface 
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area directly, but utilize the exponential height-weight formula of Du- 
Bois with exponents W*"*** H°-7*°. This amounts to standardizing corti- 
costeroid output on the basis of an exponential formula with these 
particular exponents. It appeared possible that it is the inappropriate- 
ness of this height-weight formula for output of corticosteroids that 
accounts for the apparent downward regression with age. We therefore 
undertook to determine an estimating formula for output of cortico- 
steroids in terms of weight and height obtained directly from the present 
data. Five formulas were evaluated for comparison: 


S = aW?*® H°> ~~ (DuBois) (1) 
S = aW’ H (2) 
S=aw* (3) 
S=a+tbWt+ceH (4) 
S=at+bdw (5) 


where S is the corticosteroid output estimated from the formula, W is 
weight in kilograms, His height in centimeters, and a, b, c are parameters 
determined by fitting the equation in question by least squares.* The 
fit of the equations was compared by means of the estimated mean square 
deviation of the observed and predicted value of the output; the results 
are summarized in table 1. It is seen that the prediction using the 
exponents of the DuBois formula gives distinctly the poorest fit and that 
there is very little difference among the others. The simple linear 
equation in terms of weight alone gave the best fit as judged by the esti- 
mated variance, and this was therefore adopted. The correlation be- 
tween the corticosteroid output and weight was +0.53. The cortico- 
steroids adjusted for weight were then calculated for each individual as 
the ratio of the observed output S to the estimated normal output for 
weight, S = 0.180 + 0.003 W, (analogous with corticosteroids per unit 
“surface area”). The weight-adjusted corticosteroid output in relation 
to age is shown in figure 1. It is seen that there is no evident relation to 


*It is common in fitting an exponential formula of the type 8 =a Ww to deal with the transformed 
linear equation log § =a + blog W and to fit the equation by minimizing Dilog S — log 3)? where § 
is the estimated and S the observed values. Since, however, in the linear least square solution we mini- 
mize 5(S — S§)2 and since it is this sum which is used as the criterion of goodness of fit, it is this quan- 
tity that should be minimized for the exponential formula also, This may be accomplished by fitting 
=a +b log W but using instead of log S with the actually observed S, a 


the linear equation log S§ = log Wi ng 5 us fa 
working value S’ = log S$: + (S — S81) /S: where S: is a value obtained from a preliminary fit, S is the 


observed output, and using for the weighting coefficient W = Si? (Ref. 4), 
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TABLE 1 
PARAMETERS AND VARIANCE OF PREDICTION FORMULAS* 


Estimates : Estimated 
Prediction formula =(S — S)? | D.F. | variance 
a b c 
S = a Ws 0-725 0.002 0.8088 86 0.00940 
S =aW? He 10-473) | 0.1163) | 0.291 0.5259 84 0.00626 
S=aWe 6.920 | 0.287 0.5272 85 | 0.00620 
S=a+bW+cH| 0.142 | 0.003 .0004) 0.5251 84. 0.00625 
S=at+t+dWw 0.180 | 0.003 0.5156 85 0.00607 


*§ is the ‘‘predicted’’ output of corticosteroids (mg. per twenty-four hours), S the observed output. 
W is weight in kilograms, H is height in centimeters. The estimated values of a, b, c, were determined 
by least squares minimizing 2(S — §)2. The sum of squares 2(S — §2 gives the actual sum of squared 
deviations of predicted and observed; this divided by the degrees of freedom (D. F.) gives an estimate 
of the variance about the hypothetical true curve rather than the fitted curve. 


age. Therefore the essence of Talbot’s conclusion that the amount of 
corticosteroids adjusted for body size is the same at all ages during the 
growth period is confirmed. 
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THE EVALUATION OF DIAGNOSTIC TESTS 
SAMUEL W. GREENHOUSE AND NaTHAN MANTEL 
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Introduction: The use of routine laboratory tests in diagnosing disease is 
becoming of increasing importance. This concentrated search for ef- 
fective diagnostic tests emphasizes the need for procedures to evaluate 
and compare them. The following discussion presents such procedures 
(a) under the assumption of a continuous range of diagnostic test scores 
that are normally distributed in the universe and (b) where it is assumed 
that test scores are continuous but no assumption is made about the 
distribution forms. 

Relatively few diagnostic tests correctly classify all persons tested 
as diseased or well. The more usual situation is one in which some well 
persons are classified as diseased and some diseased persons classified as 
well. Such errors do not necessarily invalidate a test, but they do make 
it necessary to define the maximum limits of error in an acceptable test. 
Thus, we can require, in general, that it classify correctly as diseased at 
least a minimum specified percentage, Pp , of those diseased, while 
classifying incorrectly as diseased no more than a specified percentage, 
Pw, of those well. For example, we might require that a test correctly 
classify at least 90% of the diseased while it incorrectly classifies no 
more than 5% of the well. The percentages specified for a given test 
must, of course, be determined from subject matter rather than statistical 
considerations. This raises the following general problems: 

A diagnostic test for a disease is proposed and it is desired to test 
the hypothesis that it meets the specified requirements. A sample of 
known positives and known negatives is drawn; the diagnostic test is 
applied and the results are analyzed for consistency with the hypothesis. 
Then, how large a sample of positives and negatives is required if it is 
desired to test this hypothesis when the probabilities of Type I and Type 
II errors are set at a and B respectively? Secondly, given two diagnostic 
tests, which one is more effective in detecting disease? 

For a diagnostic test which yields only two possible results, positive 
or negative, specification of a and 8 determines the sample size needed. 
In general, however, diagnostic tests yield a fairly continuous range of 
possible results, which are then broken down into regions which are 
labeled positive or negative. Frequently, intermediate regions are in- 
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serted. The choice of the point of demarcation of the positive-negative 
region cannot be independent of the two percents specified. One can 
always select a point of demarcation so that fewer than Pp percent of the 
diseased will be correctly classified or more than Pw percent of the well 
will be incorrectly classified. It would thus be possible to reject an 
acceptable test because of an improper selection of a critical point. In 
consequence, for any given set of experimental results designed to evalu- 
ate a diagnostic test there are at least two possible choices of a critical 
point for specified Pp and Py : that which yields exactly Pp percent of 
the diseased correctly classified, or that which yields exactly Pw percent 
of the well incorrectly classified. This formulation follows directly from 
Berkson’s [1] demonstration that there is no single omnibus measure, 
such as the biserial correlation coefficient, by which one can rate a test.’ 
Thus, the problem considered here is to determine the inherent goodness 
of a procedure devised to detect disease. This is in contrast to the situa- 
tion in which one desires to evaluate a diagnostic test for which a critical 
point has already been fixed. 

In what follows, it is assumed that for the sample of well and diseased 
there are no assignable causes of variation in the diagnostic test values 
other than the distinction between well and diseased. In practice, this 
assumption may not be met and it may be necessary, unless the sample is 
drawn with this in mind, to subdivide the sample into rational subgroups, 
such as by age or sex. This paper does not take account of procedures 
treating this problem of heterogeneity. 


EVALUATION OF A SINGLE DIAGNOSTIC TEST 


The significance test. Let us say that a good test, for a particular disease, 
has been defined as one which detects 90% or more of the diseased while 
misclassifying no more than 5% of the well, and let us assume, without 
loss of generality, that the diagnostic test yields higher values for the 
‘diseased than for the well. Then, if the diagnostic test value exceeded 
by only 5% of the well is designated by W, (the 95th percentile of the 
well distribution) and the value exceeded by 90% of the diseased is 
designated by Doo (the 10th percentile of the diseased distribution), the 
hypothesis we wish to test is that W; < Doo or Do) — W; > 0. If this 
hypothesis is false the diagnostic test is not a good one. 

We assume here that the distribution of diagnostic test values for 
both well individuals and diseased individuals is normal, or can be 
normalized by some transformation but not necessarily with the same 


; 1Neyman [2], in his work on diagnosis, has been concerned with a different problem: one in which 
it is not known which individuals examined are diseased and which are well. 
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variances. Then, if the mean and standard deviation for the well are 
designated by my and ow and for the diseased by mp and op, 


l| 


W; My + 1.645 op 


1D Yor: = Filip 1.282 op 
If we let A= Dy, — W; our hypothesis becomes 
a Mp — 1.282 gp — Mg — 645 on = 0 


For any sample, we obtain estimates of these four parameters and may 
compute an estimate of A, say A, as 


(1) Nt Se OR a GAR se 


where s is the sample standard deviation 


ox — 4 Paar): = xy’ : 
n—l 


The estimate, A, is approximately normally distributed [3] even for 
moderately sized samples, so that if the variance were known exactly a 
test of the hypothesis A = 0 is possible. Since all four variables in (1) 
are independent the variance of A is 


(2) YA) 28 (1 4 ABADI) 4 om (4 848) 


Niy 


where np and ny are the respective sample sizes of diseased and well 
individuals. An estimate of V is then given by 


(3) (a) = Sb (y 4 C282) ee siv a es Zo 


It is now necessary only to compute the value of A/ V Va) and to 
compare this value with the appropriate one-sided critical level. Though 
no exact distribution of this is available, for large size samples the 
normal distribution can be used, the critical levels being — 1.645 for 5% 


and —2.326 for 1%. 


2The values +1.645 and —1.282 correspond to the 5% and 90% points of the normal distribution, 
Similar values can be used for other percentage points, 

38This definition of the sample standard deviation leads to expressions for the variances of & and 
other sample statistics involving the factor n/(n — 1). For simplicity of presentation and computa- 
tion, the large sample assumption that this factor is equal to unity has been made, The appendix 
presents the development in which factors are introduced to yield unbiased estimates of the various 


sample statistics and their variances. 
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Determination of sample size. In testing the hypothesis A > 0 one must 
decide in advance the maximum frequency of error in testing the hy- 
pothesis. The hypothesis can be tested using a small sample, but only 
with a great risk of accepting it when false. If the diagnostic test 1s 
capable of detecting only, say, 80% of the diseased at a cost of mis- 
classifying 5% of the well, we might wish to be relatively sure of rejecting 
the hypothesis. If this alternative hypothesis is true, Deo = Ws; , and 
the expected value of A is Dy — WW, = Dep — Dal 32465 rather 
than zero. The actual value of A, however, will be less than its expected 
value plus 1.6450, 95% of the time. Thus in order to have 95% 
assurance that we will not accept the hypothesis that Doo = W; , when 
in fact Ds. = W;, we wish —.44c0p + 1.6450, to be significantly negative, 
that is to be less than —1.6450,4 . We require, therefore, that 


(4) =i A gat 1.645 o<eeieGd 5 tah 
whence 

44. 
(5) oA SS 3 99 7 


To determine minimum sample size, we solve the equality 


44 2 2 
(6) ox = 55900 = 2 ee a hee (pee 


Np 2 Nw 2 


Let K°-= enjoy. Then 


@ = A f(y 5 Ome!) (| Cae 


For any assumed value of K, any set of values np and nw which 
satisfy the above equation will reject the hypothesis A > 0, 95% of the 
time when A = —.44c,. If there exist limitations on the number of 
known diseased individuals which can be obtained in evaluating the 
diagnostic test, we are still free to determine the number of well to be 
obtained. If the cost of evaluating a test can be represented as a function 
of the number of diseased and well individuals to be tested, then np and 
Nw can be so selected as to minimize the cost. As a simple case, consider 
the cost to be linear in total number of persons tested, 7 = np + ny . 
We have to minimize np + ny while keeping 


ak 1(140 Se. 1 ea) - 1,822 | 2.353 


Knyw 2D Np Kny 
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(the argument of the square root in (7)) fixed. The usual computation 
leads to the familiar form 


Mp _ [1.822K _ = 
Ny Zao — VK 


Substitution in (7) yields 


te eee ELUG. 
K 

= 116 

ty =e + 


/K 


The sample sizes required for certain assumed values of K are shown 
below. 


Sample Size Required 
K = &°p/ayw 

Well Diseased Total 

nw Up) ah 
1/9 1534 449 1983 
1/4 758 334 1092 
2, 427 266 693 
1 248 218 466 
2 148 184 332 
+f 91 160 251 
9 54 | 140 194 


It is clearly seen that the larger the value of K, the smaller is the 
sample size which must be drawn to test the hypothesis Ws; < Doo , with 
assurance of rejection if in fact W; = Dz. However, this relation be- 
tween sample size and K does not hold for alternative hypotheses of the 
type Doo = Ws or Do = Wi etc. This arises from the fact that for 
this type of alternative hypothesis the expressions for np and nw would 
have K and +/K in the numerator instead of the denominator. 


Selection of a critical point for an accepted diagnostic test. For purposes 
of statistical testing it has been desirable to disregard the selection of a 
critical point. Once a test has been validated, it is necessary, for working 
purposes, to select a critical point. The fitting of normal distributions 
implied in testing the hypothesis of goodness of a diagnostic test is of 
aid also in selecting a critical point. 


404 BIOMETRICS, DECEMBER 1950 


Assume a population with 1 percent diseased, and a diagnostic test 
just capable of detecting 90% of the diseased at a cost of misclassifying 
5% of the well. Such a test will yield, for the population, 53 false 
positives for each true positive detected. In the neighborhood of the 
critical point, however, the test will yield a greater number of false 
positives for each true positive detected. The number of false positives 
per true positive at this point may be so large that we may not wish to 
include it in the positive region, or it may be so small that we may wish 
to shift our critical point farther to the left. 

If, for a population with proportion p diseased, we wish to include in 
the positive region, all points which yield r or fewer false positives per 
true positive, we need simply find the point at which the number of false 
positives equals r times the number of true positives. This is given by 
the solution for X to 


ey exp - (x — om Se exp - See 
ow 20 20% op V2 2op 
Mp?d w Myop 
Gf eae 
ane Sie oe be a, 
owopd (1 — p)op 
Sis 2 2 
Ci aa OID 
and for the case 
OV? == Cy = w& 
_ My + Mp o rp 
) os 2 My — Mp log. (1 — p) 


For ow ¥ op, there are two solutions for X. Since we may not wish to 
trust the assumption of normality to the limit, we should ordinarily 
accept only one of these. It would be reasonable, however, if there were 
a great disparity of variances between the two distributions, but with 
means near each other, to use two critical values and to assign “wild” 
values in either direction to the same diagnosis. For op very much 
greater than ow there would then be two positive regions and an inter- 
mediate negative region. 

One possible critical point of interest is that for which r = (1 — p)/p. 
At this point the number of false positives per true positive is the same as 
the ratio of the number well to the number diseased for the population. 
At this point the ordinates of the two unit area normal distributions are 
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equal, and the difference between the percentage true positives and 
and percentage false positives is a maximum. A disadvantage of the 
use of this point as a critical point is that in classifying persons as positive 
at this point we are doing only as well as we could do by a chance classi- 
fication procedure. But it excludes from the critical region all points 
at which we would get results worse than chance, and therefore is the 
most extreme value we could consider. 

The value of p, the population proportion diseased, is of interest also 
in the case where we do not have a group of known well individuals. 
Instead we may have only a group of known diseased, and a group of 
unknowns from which to sample. The value of p should be allowed for 
in determining the proportion of unknowns which may fall in the positive 
region. 


COMPARISONS OF TWO DIAGNOSTIC TESTS 


If we have two different diagnostic tests we may be interested in 
knowing which is the better test. Under some circumstances, the ap- 
propriate question may not be which is better, but rather, what is the 
best way of using both diagnostic tests simultaneously: setting up critical 
points for each test and requiring a positive value on one or both tests; 
or possibly setting up a linear combination of scores on the two tests 
which differentiates maximally between well and diseased. This ques- 
tion is related to the degree of independence of the two tests. In this 
paper attention will be restricted only to the question of which is the 
better diagnostic test. 


Tests on independent samples. Diagnostic test 1 has been applied to one 
sample of known diseased and known well individuals, diagnostic test 2 
to another sample and the results are to be used to test the hypothesis 
that the diagnostic tests are equally good. (Determination of sample 
sizes needed for testing this hypothesis is not considered in this section, 
but can be obtained by a method parallel to that shown previously.) 

We cannot unequivocally state that one diagnostic test is better or 
worse than another, unless we specify the percentage of false positives, or 
false negatives, we are willing to accept. Making the assumption of 
normality, it is only when op;/ow1 = p2/7w2 that a statement of the 
relative goodness of two diagnostic tests is independent of the acceptable 
percentage of false positives or false negatives. Otherwise one test may 
be superior for one choice of a critical point and inferior for another 
critical point. Any statistical procedure that does not take account of 
this is likely to prove seriously misleading in practice. 

A more appropriate general procedure would appear to involve (a) 
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pre-selecting a maximum acceptable level of false positives, say 5%, 
(b) determining the critical points of the well distributions for this 
acceptable level for both tests, (c) computing the percentage of the 
diseased population which lies above this point for each test and (d) 
calling that test which yields a higher percentage above the critical 
point the better test for the predesignated level of false positives. 

It is more convenient, however, to work with the normal deviate 
corresponding to the percentage. We shall thus define 


G = By (mp Sad WAS ie ae 1.645 ow) 
op 


and the diagnostic test for which G is greater is the better test. 
The sample estimate of G is given by 


D 
The variance of G@ is 
Ga 1 Ow (1.645) om) 
(11) V@ = ye A oa + ede + omer 
which can be estimated by 
(12) V® = 5 ils ~ + si 4s (1.645 Sw). 


2 
NwSp DAS 


The statistical test to be applied now requires estimating for each 


diagnostic test the value of G and its variance and computing 
G. ae G: 

i 
VG) + VG.) 


which can be considered a normal deviate and applying a two-sided 
significance test. 


Tests on dependent samples. The statistical test just considered is ap- 
propriate when separate samples are drawn for the two diagnostic tests. 
If, however, the same individuals are used for both tests, we should expect 
to make more efficient use of our sample by taking into account the 
correlation of scores on the two diagnostic tests. 


For this purpose we compute G, — G, in the same way as for inde- 
pendent samples. But now 


VG = G) a VG.) = VG.) = 2C V(G,G.) 
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where CV indicates covariance and is given by 


(13) CVG, G) = en ane = Pwo wi we a (1.645 Pw) Twio we 


Np Nw pid p2 2Nwop1o D2 


where pp is the correlation of scores on the two diagnostic tests for 
the population of diseased individuals, pw for the population of well 
individuals. Again, inserting sample values for the population param- 
eters in (13), we obtain an estimate of the covariance, which together 
with the estimates of the variances of G, and G, provide the following 
estimate of V(G, — ESP 


VG. — @) = 5 G+ G - 230.0, — ry +4 
(14) 
- Se E 3 | ~ ee [2ry + (1.645ry)”| 
Then 
poten Ge Co 
VVG, — G) 


DISTRIBUTION-FREE SIGNIFICANCE TESTS! 


In the preceding sections the significance tests have been based on the 
assumption of normality of the diagnostic test scores, or some trans- 
formation of them. Opposed to the procedure of computing a percentile 
on the basis of sample estimates of the population parameters is the 
procedure of estimating a percentile by counting in the sample. The 
latter estimate can always be made, assuming large enough samples. 
However, where the population distribution form can be assumed to be 
normal, counting is less efficient. It is well known, for example, that for 
a normal population, using the median has an efficiency of 64% com- 
pared with the use of the sample mean in estimating the 50th percentile. 
For other percentiles, the relative efficiency of counting is even less. 
For example, in the 5th to 10th percentile range, the relative efficiency of 
counting is approximately 50% to 60% and at the 0.1 percentile, the 
relative efficiency decreases to 6%. 

If, however, it is believed the population distribution form differs 
sufficiently from normality to invalidate the calculation of a percentile 


4Tests for comparing percentage points in arbitrary, continuous distributions have been considered 
by Marshall and Walsh [4]. For large samples, the methods presented here are equivalent to those 


given in [4]. 
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as m + to, an estimate of the population should be made by counting in 
the sample.” 


Evaluation of a single test. If we estimate W,; and Do. by counting in our 
sample the variances of the estimates are approximately 


(.05)(.95) (.10)(.90) 


2 2 
Nwews NDEDeo 


and 


respectively. zy, and zp,, are the probability densities per unit interval 
in the respective distributions at W; and D,) . Estimates of zw, and 
Zp,, can be made by smoothing the data of the samples and using the 
smoothed ordinate. The test of the hypothesis W,; < Doo is then given 


by 
(15) i= Eves 


ee a (.10)(.90) 


AZ 
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Comparisons of two tests-independent samples. For comparison of two 
diagnostic tests, using independent samples, we must again specify the 
acceptable percentage of false positives or false negatives. For 5% 
false positives acceptable we consider that test better which gives the 
larger percentage of true positives. By counting, for diagnostic test 1, 
we find at W, the percentage true positives in the sample of positives 
to be Pp, . The variance of the estimate Pp, , taking into account the 
variance of W; x ils 


(16) V(P>:) ~ Pol Pp1) a (.05)(.95) x Zn 


D1 Nw 21 
where the z’s are the probability densities at W, for the respective 
distributions, and can be estimated as before. P pi can be used in place 
of Pp, , and for large enough n, the bias correction in Pp, , is trivial. If 
similar estimates are made for diagnostic test 2, the significance test 
becomes 


(7) t= 
(Pr1—P ps) 


[Pes Pon a ee Te .05)(.95)| (22) + 1 (é2)'| 
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’John Tukey makes the valuable suggestion that non-normality may not seriously affect the 
approximation of the 5% point as m + 1.6450, but the effect of non-normality on the variance of s 
should be taken into account in testing significance if we use procedures which assume normality. 
This can be done by multiplying o2/2n, the variance of s assuming normality, by (82-1) /2, where 
B2 = w4/y2 , for which an estimate can be obtained from the data, 
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Dependent samples. Where the same sample is used for both diagnostic 
tests we may obtain Pp, and Pe as above. ‘The covariance of Pe , and 
Pp. must be taken into account however. These variances and co- 
variance are composed of two independent parts—a part due to variation 
of diseased individuals, and a part due to the variation of the critical 
point. 

Making the usual Taylor series approximations we obtain for the 
variance of Pp, — Pp» 


Ppl mae Pp:) 4. Pall = Pp») 


Np Np 


VP a: =a Pes => 


2 / 
— F. VPoPooll — Pol — Pos) 


at 0598) (Ie) i | a Qp'y epi 2] 
Ny Wi ewe 2wi “wa 


where p’/, is the correlation of the diagnostic tests in the diseased popu- 
lation, p%y in the well population, using scores of zero for values less than 
the population W; , scores of one for values greater than W, . 

If in our sample of diseased individuals, ap individuals are classified 
as positives (exceeding W;) by both tests, the sample value rp is then 


(18) 


a an, Fa Zz a 
(19) TD = (22 a PosPos) / A) Px Pol = jean) Gl aa Rao) 


And the sample value, r’y , if ay well individuals are classified as positive 
by both tests, is 


(20) ry = (= a (.05)") Q (.05)(.95) 


Then, for large enough samples, using sample values of the P’s, 2’s, 
and p’’s, we have, 


V(Po a Ea = 1| Pnc = Pp) ae Ppl — Pp2) 


(21) + 2PpPo — | a a (2) a (2) 
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(22) i Gh = Ps) Vien = jes) 


This test cannot be applied when we are considering two diagnostic 
tests which are both so good that there is no overlapping of values in the 
sample for diseased and well individuals. The test assuming normality, 
when justified, however, is applicable whether or not there is overlapping. 


APPENDIX 


For the development of estimates.and variances below and in the 
text, use has been made of the following properties of the normal and 
bivariate normal distributions: 


Ea) = m 
EG) = oF 
ae) 
o seeps meme st 
Oe ures LE Sg ee 8 


s/o n— ,) — a Nn — 23 
aS 
1 Litt 
(2) on—3 
ge 
VS) = 9G, = 1) 
oe: 
Viz) = — 
Pz,9 = Pryy 
2 
Pse,sy = Puny 


Pz,sx = Pa,sy = Pos = Pa,sy = 0 


Use is made of the Taylor series approximation for obtaining vari- 
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ances and covariances of products and ratios, with expansion about 
expected values, e.g. 


cult 2) [o(2)(2) Jere. 
8) (0) ve + (fv 


The approximation to V(1/s) instead of its exact value is made for 
consistency with the approximation used for CV(1/s,, 1/s,). 

We can then obtain the following formulas corresponding to those 
in the text giving unbiased estimates (the subscript wu referring to 
unbiased). 


a Mp — 1.282 op. — ign 1.645 Ow 
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For independent samples CV (Cae G,,) = 0. For identical samples 


CVG» Go.) me PPGnGe 4 Po 4 Pwowiows , (1.645 SO eeatae 
lu 3 Qu 


— 2Nny—5d Np Nw? pi? p2 (2ny = 3)op1op2 


for which no unbiased estimate is obtained. 

Although no tables exist for making the exact tests of significance 
implied above, for the large size samples necessary to evaluate diagnostic 
tests, the use of the normal deviate will be appropriate. For such sam- 
ples, there will be only a trivial difference between the biased and un- 
biassed forms. However, it is likely that existing tables of ¢ and the 
normal deviate come closer to describing the unbiased rather than the 
biased forms. In addition, to the extent that G may be considered a 
population parameter measuring the goodness of a diagnostic test, the 
unbiased estimate of G may be preferred. 
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ABSTRACT 


| ads (Spearman’s) Method, the Reed-Muench (Behren’s) Method, 

and the Cornfield-Mantel iterative approximation to the maximum- 
likelihood estimate of the LD;, are compared. The performance of each 
method is evaluated by small sample analysis, and an index of “worth” 
is introduced to facilitate the comparison. 


ESTIMATES OF THE LDso 


The simplest stimulus-response problem, and the only one considered 
here, employs an experimental design with several dosage levels of some 
deleterious substance and the same number of test animals at each level. 
The purpose of the experiment is to estimate the dosage level at which 
50% of the animals would die. This dosage level, generally known as the 
LD;, , is then used as an index of the potency of the toxin. 

The various estimates of the LD,» are relatively old, one of the most 
venerable being ‘‘Karber’s Method” which was developed by Spearman 
in 1908 (1). The method has a curious history of popularity and disuse. 
It was employed by Karber for bioassay in 1930 but ran into criticism 
shortly thereafter. It was advocated (with reservations) by Irwin (2) 
but rejected by Finney (3). Cornfield and Mantel (4) discuss the 
theoretical derivation and use it as a first approximation to the maximum 
likelihood solution. 

The Reed-Muench Method (5), which is also called Behren’s Method, 
has been used by research workers for a quarter of a century but has also 
been heavily criticized. One objection, that no estimate of standard 
error was available, was recently overcome by Dr. Mario Pizzi in his 
doctoral dissertation (6). 

Although the “probit” method is also an old one, it did not attain 
popularity until the middle thirties at which time the method of maximum 
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likelihood was applied and certain computational difficulties were over- 
come by tabulation. Because of its superior theoretical foundations, 
it has been strenuously advocated. The “probit”? method (a) assumes 
that the probability of death at any level follows an integrated normal 
distribution, and (b) uses the method of maximum likelihood to obtain 
the estimate. 

A catalogue of the variant methods will not be attempted here, but 
the divergences take two directions. Other fundamental curves have 
been proposed to replace the normal. The most important of these is the 
integrated logistic curve, which will be used in this analysis, but various 
other candidates are in the race. Principles of estimation other than 
maximum likelihood, such as least squares, minimum chi square (7), 
and mean moving averages (8), have also been suggested. Over twenty 
different estimates of the LD; are currently on the market. 

The partisans for the different estimates have advanced conflicting 
claims concerning the efficacy of their methods. The main arguments 
concern (1) computational convenience, (2) improved accuracy and 
generality, and (3) closer correspondence with the real world. 

Insofar as the computations are concerned, the Spearman-Karber 
Method is the simplest, although the Reed-Muench Method is only 
slightly more difficult. The methods approximating the maximum 
likelihood solution are all fairly tedious. 

The question of correspondence with the real world is one which must 
be considered separately for each experimental situation. However all 
of the fundamental curves currently employed are symmetric, unimodal, 
two-parameter curves. 

It is in the consideration of accuracy that most of the controversy 
arises. One of the main reasons for this confusion is that the arguments 
are often based on large (infinite) sample statistical theory although the 
experimental designs often have twenty animals or less in the sample. 

The purpose of this paper is to examine the question of accuracy in 
small samples. 

Three methods of estimation were chosen for comparison. The 
Spearman-Karber and Reed-Muench Methods were selected because 
they are currently used and are well suited to the computational facilities 
of the ordinary research worker. Since the logistic was chosen as the 
fundamental curve, a direct comparison cannot be made with the Probit 
method. However Cornfield and Mantel have developed (4) an iterative 
approximation to the maximum likelihood solution for the logistic case 
which is analogous to the Probit method. This Cornfield-Mantel method 
was therefore chosen for comparison. 
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SMALL SAMPLE ANALYSIS 


While methods of estimation may be shown to have very desirable 
properties in large samples, such as minimum variance, it does not follow 
that these advantages are retained when the sample size becomes small 
(and practical). In order to make a valid critique, it is therefore neces- 
sary to resort to small sample analysis—a complete enumeration of cases. 
Unfortunately this is a “brute-force”? approach and requires extensive 
computation. 

As a first step, the logistic was chosen as the fundamental response 
curve. The logistic resembles the normal curve in appearance, but it has 
somewhat longer tails. Moreover, the integral of the logistic has a simple 
form, and there is some evidence that the logistic provides a better ‘fit’ 
in certain applications. It was especially convenient because a good deal 
of the necessary computation had already been done by Dr. Pizzi for 
this curve. 

It would have been possible to fix the dosage levels and to vary the 
two parameters of the logistic, but it was somewhat easier (and mathe- 
matically equivalent) to work with the function. 


(1.01) Pr (an animal dies at dosage d,) = ——— 
1+e”™ 
and to vary the location and spacings of the levels. 

Thus it was assumed that 
(1.02) d, =a, + (k — 1)D 
where d, is the dosage at the lowest level, and D is the spacing between 
levels. 

It is common biological practice to use the logarithms of the dosages 
as an index in order to improve the fit with the fundamental curve. The 
actual doses would be in geometrical progressions and it would be the 
logarithm of the k-th dose which satisfied (1.02). 

If we now consider an experimental design with m levels (k = 
1, 2, --- , m) and n animals at each level, there will be (m + 1)” possible 
outcomes. The probability of any outcome may be found as a product of 
binomial probabilities. 

For any choice of ‘“‘spacing”’, D, and “‘location”’, d, , the probability 
that an animal will die at a particular level may be found from (1.01). 
These values, substituted in the product of binomial probabilities, will 
give a numerical value for the probability of each outcome. 

The next step is to calculate, for each outcome, the estimates of the 
LD; by the three methods of estimation. This provides, in numerical 
form, the distributions of the estimates. 
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It will be noted that the amount of computation rapidly becomes 
astronomical. The special case m = 4 and n = 2 (81 outcomes) was 
evaluated for nine spacing-location configurations. The special case 
m = 4and n = 5 (1296 outcomes) was evaluated for two configurations. 
It is realized that the conclusions afforded by this limited number of cases 
are not incontrovertible, and it is hoped that additional small sample 
analysis may fill some of the gaps. 


A CRITERION FOR COMPARISON 


It is not at once obvious what standards for accuracy can be used in 
small sample analysis. In large sample theory, the variance is the usual 
index for comparison. Three difficulties arise in the small sample case: 
(1) estimates may be infinite or may not exist for certain outcomes, (2) 
some outcomes are so peculiar (i.e. mortality decreases with dosage) that 
they might plausibly be rejected altogether, (3) the distributions may be 
markedly non-normal so that the ‘‘variance”’ is subject to misinterpreta- 
tion. Due to the process of squaring, aberrant estimates may contribute 
heavily to the variance although their probabilities are small, and many 
workers would prefer to repeat such experiments. 

In view of the objections, the index of comparison used in this critique 
is 
(1.03) Wo =tPr T= 6 ae) 


where 7’ is the estimate, @ its true value, 6 a positive number. Equation 
(1.03) states that W is the probability that the absolute error in the 
estimate is less than or equal to 6. A plot of W against 6 was made for 
the different spacing-location configurations and for all three methods 
of estimation. 

The choice of this criterion is necessarily somewhat arbitrary. A 
more precise treatment would consider the consequences of errors of 
various sizes. The criterion is essentially based on equal costs for error 
in each direction and an all-or-none cost function. 

In other words, if we assume that an estimate is “worthwhile” if it is 
in the interval @ + 6, and ‘“‘worthless’’ otherwise, then W would be an 
index of the “worth” of a method of estimation. Presumably the value 
a research worker would choose for 6 would be different in different ex- 
perimental situations. However if the worth of one method of estima- 
tion was greater than the worth of a second method for all values of 6, 
it would seem reasonable to say that the first method was superior. 


TWO ANIMALS PER LEVEL 


When four levels are used with two animals per level, the number of 
outcomes, 81, is small enough so that the case may be fairly thoroughly 
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GRAPH I 


“WORTH” OF ESTIMATES—2 ANIMALS AT EACH OF 4 LEVELS WITH PROBABILITY OF 
DEATH AT LEVELS EQUAL TO .10, .32, .68 AND .90. 
W = Probability (| 7 — @| < 6) 
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explored. The Cornfield-Mantel (CM) estimate was calculated for thirty 
cases. The omitted cases were those with marked peculiarities. The 
cases calculated accounted for about 95% of the probability in all 
spacing-location configurations studied. The Spearman-Karber (SIX) 
and Reed-Muench (RM) curves are for these same thirty cases. 


418 BIOMETRICS, DECEMBER 1950 


GRAPH II 


“WORTH” OF ESTIMATES—2 ANIMALS AT EACH OF 4 LEVELS WITH PROBABILITY OF 
DEATH AT LEVELS EQUAL TO .59, .86, .96 AND .99. 
W = Probability (| 7 — @| < 6) 
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Graphs T and IT may be regarded as typical of the nine configurations 
computed. Graph I is for the case where the probabilities of death at the 
four levels were .10, .82, .68, and .90 respectively and resembles the 
symmetric case for narrower spacings. In Graph IT the corresponding 
probabilities are .59, .86, .96, and .99, so that the LDs. lies outside the 
levels used. Vor this case all the animals would die about a quarter of 
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GRAPH III 


“WORTH” OF ESTIMATES—5 ANIMALS AT EACH OF 4 LEVELS WITH PROBABILITY OF 


DEATH AT LEVELS EQUAL TO .10, .32, .68 AND 90. 
W = Probability (| T — @| < 4) 
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the time. There is no finite RM or CM estimate for this outcome. The 
cases of milder asymmetry had graphs more or less intermediate between 


Graphs I and II. 

In nearly all cases W sx was greater than either Wp or W cw for all 
values of 6. The single exception was one in which a CM was closer to 
@ than any SK estimate so that for a small interval near the origin, 
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GRAPH IV 


“WORTH” OF ESTIMATES—5 ANIMALS AT EACH OF 4 LEVELS WITH PROBABILITY OF 
DEATH AT LEVELS EQUAL TO .59, .86, .96, AND .99. 
W = Probability (| 7 — @{| < 6) 
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Wem was higher. The advantage was quickly lost as 6 increased. The 
relationship between W py, and W car Was not consistent, and occasionally 
these curves actually crossed. Usually Wear was greater than W cM. 
It should be noted that of the nine configurations considered, the 
LD,» was, at worst, located somewhat below the lowest dosage asl 
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The narrowest spacing was such that the probabilities ran from .59 to .86. 
A wider spacing was more favorable to the SK Method (as theory would 
indicate). 


FIVE ANIMALS PER LEVEL 


Since there are about thirteen hundred possible outcomes when there 
are four levels and five animals per level, a complete enumeration was 
beyond available resources. For the probability levels of Graph I, it was 
found that three hundred cases accounted for all but .1% of the proba- 
ability, and Graph III indicates the results for these cases. No curve 
for the CM Method is shown as the calculation of this estimate for the 
three hundred cases was not feasible. 

The Ci estimate was calculated for nineteen outcomes constituting 
about 40% of the probability, but in most of these cases the correction 
was negligible. In the symmetrical situation, the true LD;. was midway 
between the second and the third level. When the original estimate was 
wide of the mark (i.e. toward the extreme levels), the maximum likeli- 
hood correction moved the estimate still further away from center in 
almost all cases. Hence the Wey curve would be close to, but somewhat 
under, the Wx curve. 

This behavior of the maximum likelihood correction indicates that 
when the true value is located at or near the center of the levels, the SK 
solution will always be superior to the maximum likelihood solution. 
This result should hold regardless of m and n, although as the sample 
sizes increase, the difference becomes negligible. 

The critical question therefore is, “‘What happens when the true value 
is not central?”’? Presumably the displacement produced by the iterative 
process will then be in the “right’’ direction and hence would do some 
good. 

The asymmetrical probabilities (.59—.99) previously utilized in 
Graph II were also employed for the five animal case. It was found that 
48 outcomes would account for slightly over 90% of the total probability, 
and the results of these outcomes are indicated in Graph IV. 

For very small values of 6, Wem is superior to Wsx although the 
difference is slight. For larger values of 6, Wsx gains a marked ad- 
vantage. The reason for the failure of the maximum likelihood correc- 
tion is that it “overcorrects”; although the SK estimate is an over- 
estimate in most cases, the ‘“‘corrected’’ estimate is an underestimate 
which is still further from the true value. 

The curious twisting behavior of Wc is due to the asymmetry of the 
distribution. If the sign of 7 — @ is taken into account, the curves are 
much more regular, although, of course, part of the irregularity is due to 
the omitted outcomes. 
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It should be noted that most of the probability in this asymmetric 
case is concentrated in outcomes which are such that a cautious research 
worker would probably prefer to repeat the experiment using different 
levels. Hence while it might be that for still more extreme asymmetry 
Wem might gain the advantage, it would be of little practical importance, 
since it is not usual to attempt any estimate whenever the proportion 
dying at the lowest dosage is more than 50%. 

Graph IV is unfair to the Reed-Muench Method in a sense because 
only interpolative estimates were used. Hence no RM estimate was 
possible in many of the cases. Extrapolative estimates were attempted 
and gave results rather similar to the CM estimates so that if such esti- 
mates were allowed, the Wp» curve would be higher. 


CONCLUSIONS 


While the small sample method is limited by the fact that only a few 
location-spacing configurations can be evaluated, the results of the cases 
investigated are consistent enough so that the following general con- 
clusions may be stated with some confidence. 

(1) The Spearman-Karber Method of estimating the LD;, provides 
superior estimates. It is also the simplest computationally. 

(2) The Reed-Muench Method is fairly effective. It is also simple 
computationally. Some idea of the loss in accuracy entailed may be 
obtained by a study of Graphs I-IV. 

(3) The Cornfield-Mantel iterative approximations to the maximum 
likelihood estimate do not improve the accuracy of the Spearman-Karber 
Method. The additional work seems to be wasted insofar as the LD;, 
is concerned. 

It is highly interesting, although perhaps disconcerting, that older 
and computationally simpler methods should outperform the more 
“sophisticated” and difficult procedures derived by mathematical stat- 
isticians. 
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THE PLANNING OF PROBIT ASSAYS 
Wile di, 18, LebovMey‘e 


Rothamsted Experimental Station 


Summary—Graphs are presented from which the number of test sub- 
jects necessary to achieve a desired degree of precision in a 6-point probit 
assay may be determined. 


HE DESIGN of probit assays has been discussed by Finney (1947a) and 

the main considerations are well known. It is desirable for corre- 
sponding doses of the standard and unknown preparations to give 
approximately the same response, and the range of doses should not be 
such as to give responses near 100% or 0% as the weights attached to 
such responses are small. The most accurate design of assay is the 4- 
point in which two doses of each preparation are used, but as this does 
not give an adequate test of the assumptions of linearity and parallelism 
on which the assay is based the 6-point design is usually to be preferred. 
Three doses of each preparation are used, and these are best taken as 
equally spaced on the logarithmic scale. 

In such an assay (assuming no control mortality or heterogeneity in 
the responses), the accuracy of the estimated relative potency can be 
roughly assessed in advance provided a preliminary estimate of the slope 
of the probit line can be made, as is often the case in practice. It is the 
purpose of this note to enable the user of probit assays to plan in advance 
the number of test subjects needed to attain the degree of precision which 
he requires. It is assumed that a 6-point design is used, and that equal 
numbers of test subjects are used at each dose. 

Slopes of 1, 2, 4 and 8 have been taken, and for each slope six cases 
have been considered. First, the centre dose of the standard has been 
supposed to give a response of 5 probits (50%) or of 5.5 probits (about 
70%). These situations will be referred to as centred and uncentred 
respectively. Secondly the logarithm of the relative potency (denoted 
by M) has been taken as 0, 0.15 and 0.30. For each case a number of 
spacings between doses have been investigated. A fairly wide spacing is 
necessary to determine the slope adequately, while too widely spaced 
doses produce undesirable extreme responses. For each situation there 
is thus an optimum spacing, which turns out to be almost independent 
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of the number of test subjects used. Recommended spacings in terms of 
the ratio between successive doses are given in the accompanying table. 


RECOMMENDED DOSE-RATIOS 


oe 0 0.15 0.30 
Slope \ 
1 1a tes.8 ilo 
2 iP oP 13 ie us) 
4 6 i Pie’ ees 
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The same ratios may be used for the centred 
and uncentred cases. 


The 5% fiducial limits of the log relative potency are given by 


M+ aa (M — #, + 4) 


1.96 1 1 (€. — @, — M)’ 
a py) la . a zr -Jo) 3 Dior. | 


(cf. Finney 1947b, p. 66) where the symbols have their usual meanings. 
For each of the cases considered the recommended spacing was taken and 
the quantity following the + sign was calculated for different values of n, 
the number of test subjects at each dose. The results are plotted in figs. 
1-6. 

The use of the graphs is best illustrated by an example. Suppose 
that an assay is being planned in which the standard preparation is 
known to give a slope of about 3, and that it is possible to arrange for a 
response close to 50% at the centre dose. Little is known about the 
unknown preparation, and it may be as much as twice as potent as the 
standard. It is desired to determine the log relative potency with 5% 
fiducial limits of, say, +0.20. The situation corresponds to the centred 
case with M = 0.30. From the table it is found that successive doses 
should be in a ratio of 1:3.5, and Fig. 5 shows that about 30 test subjects 
should be used at each dose. 

It should be noted that while the precision read from the graphs is 
that to be expected in the various cases, there is in general about a 50% 
chance of getting less accurate results. This is true of most of the com- 
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FIGURE 1 
M = 0, CENTRED 
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monly used methods for predetermining the amount of material to be 
used in an experiment (Harris et al., 1948). On the other hand, the 
results given for the uncentred cases are pessimistic, in that they assume 
that the effects of lack of centreing and of relative potency combine to 


reduce the expected precision, whereas these two factors may work in 
opposition. 
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FIGURE 2 
M = 0, UNCENTRED 
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I am grateful to Dr. C. Potter and Dr. F. Yates for advice in the 
preparation of this paper. 
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FIGURE 3 
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FIGURE 4 
M = 0.15, UNCENTRED 
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FIGURE 5 
M = 0.30, CENTRED 
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FIGURE 6 
M = 0.30, UNCENTRED 
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SOME OBSERVATIONS WITH RESPECT TO 
THE ERROR OF BIO-ASSAY* 


JosepH Brerxson, M.D. 


Division of Biometry and Medical Statistics, 
Mayo Clinic, 
Rochester, Minnesota 


N TABLE 1 is shown a comparison, for ten examples of bio-assay 
experiments obtained from published data, of the L.D. 50 as estimated 
by eight different methods: (1) probit, maximum likelihood; (2) logit, 
minimum X’; (3) probit line fitted graphically; (4) logit line fitted 
graphically; (5) Reed-Muench method; (6) Karber method; (7) Thomp- 
son moving average method; (8) straight line fitted by eye. The L.D. 
50’s are contained in the body of the table. In the bottom two rows are 
given the standard deviation of the estimates obtained by the different 
methods, and the ratio of this to the calculated standard deviation, the 
last obtained from the probit maximum likelihood solution by the usual 
formula. 

The ratios varied from 0.13 to 0.68, seven of the ten being less than 
0.5. Assuming the calculated standard error by the probit method to be 
the actual error of repeated experiments with the use of that method, 
this means that with a particular set of data before us and the potency 
estimated from the probit maximum likelihood line, if we were to compare 
the L.D. 50, on the one hand with the estimate obtained by another of 
the proposed methods, and on the other hand with an estimate obtained 
with the same probit method using another sample, the difference ex- 
pected from the next sample would be twice as large as that from the 
alternative method. It is clear, therefore, in so far as these examples are 
representative of the data available for statistical bio-assay, that the 


practical importance of utilizing one rather than another of the proposed 
methods is generally small. 


a ee 


*The material in this note was presented in a paper delivered by the author at a joint session of the 


Biometrics Section of the American Statistical Association, and the Biometric Society, E.N.A.R., in 
New York, New York, December 30, 1949, 
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Some investigation was made to compare the standard error calcu- 
lated by the usual formula with the standard error of estimates obtained 
by the probit maximum likelihood method, when experiments were 
repeated under essentially the same conditions. Only a small amount of 
data suitable for the investigation was available. It was found that the 
actual error was from three to ten times as large as the calculated error. 
These findings will have to be checked by the performance of an adequate 
number of experiments, properly designed for the purpose, before they 
can be considered definitive. But in so far as these preliminary results 
are representative, they indicate a serious defect in the statistical 
“model” utilized for the calculation of the error of the L.D. 50. The 
model utilized implies sampling from an existent population with no error 
in the independent variate, dosage. Actually the bio-assay experiment 
is a “controlled experiment” with error in dosage.” To clarify this 
question, mathematical investigation will have to be made of the statistics 
of experiments performed under the latter circumstance, as respects the 
error of estimate of the L.D. 50 and other aspects of procedures used, 
such as tests for linearity and tests for heterogeneity. 
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QUERIES 


QUERY: J[ serve as medico-legal advisor for the court. The law 

85 forbids people who are intoxicated with alcohol to drive cars, and 

drivers who have more than 0.05 percent alcohol in their blood 

are sentenced to jail. Whenever a car driver is suspected to be intoxi- 

cated, three blood samples from him are sent to my laboratory for 
analysis. My material looks like the following table. 


Percent Alcohol in Blood 
Person — 
Sample 1 Sample 2 Sample 3 Mean 
1 0.08 0.06 0.06 0.067 
Y 0.14 0.18 0.16 0.160 
3 0.00 0.02 0.01 0.010 
et cetera 


I have made determinations on the blood of several thousands of 
persons, and I want to make fiducial statements for my data, being 
willing to run only a minimal risk of being wrong, e.g. corresponding to 
the 0.999 999 probability point. 

My practical problem is, based upon the whole material, to state 
fiducial limits for the alcohol concentration of each person, determined 
as the mean of 3 analyses, e.g. that person 1 has 0.067 + L percent al- 
cohol in his blood. 


Yours is a good idea, to calculate an average variance of 
ANSWER: the 3 samples per person, based upon the whole material. 

With the quantity of data you have, this average may be 
taken as specifying the standard deviation of the population of samples, 
subject to the following conditions. 

First, your laboratory processes should be under some kind of statis- 
tical control so as to insure uniformity in your determinations. His- 
torically, evidence can be got from examination of your standard devia- 
tions as a time series. We shall assume that there is neither trend nor 
short-time fluctuation in the standard deviations. 

Second, any correlation there may be between mean and standard 
deviation must be eliminated or evaluated. A two-way table with means 
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m classed in intervals along one border and standard deviations s on the 
other should furnish the evidence. If m and s turn out to be indepen- 
dently distributed, then the mean of the variances s* may be taken as 
the population variance, o°. You will be assuming normal distribution 
of your samples from populations having common o. The confidence 
interval for each person will be m + to/+/3 where m is the mean of the 3 
samples and ¢ is a normal deviate selected at the desired probability level. 


A.TREGRESSION OF 3 ON m ASSUME aShs 
‘ ESS D TO BE REGRESSION OF : 
B: CONFIDENCE BELT FOR m, cage 
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If there is a regression of s on m two plans may be tried. If you can 
find a transformation that will eliminate the relation and will leave you 
with reasonably normal distributions, the transformed data can then be 
used for calculating o” and for setting confidence intervals. 

Incidentally, if you discover a regression then the time series of s 
should be separated into several series, one corresponding to each class 
of m. 

If transformation is not successful, it would seem that the large 
quantity of your data will warrant the assumption that your regression 
of s on m adequately represents the regression of the corresponding 
population parameters, ¢ on uw. The curve may be like that in the upper 
part of the figure. Perhaps a graphical determination of the regression 
is sufficiently accurate, or you may wish to fit some function such as a 
polynomial. 

For each yu, the probability is p that a mean of 3 observations will lie 
within the interval » + tc/+/3, t being again the chosen normal deviate. 
This interval is plotted on either side of the regression line m = yu in the 
lower part of the figure. The confidence belt between the curves may be 
used by inversion to specify CD, the confidence interval on yu, from 
m— L, tom + L, , corresponding to the mean m of the percentage 
alcohol in a person’s blood. It is clear that L, and L, may be expected 
to differ. These limits may be determined graphically or by use of the 
function fitted to the regression of s on m. 

We have assumed that you have been calculating s for each person 
and that the results are available for study. If not, your large quantity 
of data warrants the use of the range of each trio of samples in lieu of s; 
for samples of 3, the efficiency of the range as compared to s is 0.99. In 
samples of 3 from populations with common o, the average range multi- 
plied by 0.591 is an estimate of co. 

Your suggestion of 0.999 999 as the probability desired seems to us 
unrealistic. In practice, distributions are never normal, whereas we 
have used the normal model in the foregoing suggestions. Again, we can 
only approximate o and the regression of o on pw. Also, there are doubt- 
less changes in the accuracy of your laboratory techniques, making o 
for any « somewhat inconstant. These inaccuracies make it futile to 
seek probabilities such as the one specified. Our recommendation 
would be to select ¢ = 1.960 at the 0.95 level or t = 2.576 for P = 0.99, 
then report to the Court the corresponding confidence interval with each 
mean. This information, along with other evidence, would be used by 
the Court to reach a decision. 

C. I. Briss 
C. P. WINSOR 


THE BIOMETRIC SOCIETY 


The Biometric Society was represented at the third World Health 
Assembly of the W.H.O. in Geneva last May by President Linder. At 
the sixth session of the W.H.O. Executive Board which followed, the 
official relations of the W.H.O. with non-governmental organizations 
were reviewed. In reporting its approval Dr. Brock Chisholm, Director 
General of W.H.O. wrote as follows: “The close and cordial relations 
which have been developed between your organization and W.H.O. in the 
field of mutual interests have already proved to be of great value to us, 
and I look forward with pleasure to an increase in their value in the 
future.” 


The Biometric Society serves as the Biometric Section of the Inter- 
national Union of Biological Sciences. Delegates of the Sections and 
officers of the IUBS met recently in Stockholm on July 7-11, primarily 
to review the activities of the Sections and to plan for the future. 
Professor Arthur Linder, President of the Society, and Dr. Bertil Matern, 
Statistician at the State Forest Research Institute in Stockholm, served 
as delegates of our Section. 

Professor Linder summarized the activities of the Society and Section 
during the last three years and reviewed our tentative plans for the 
period 1950-19538. Financial support has been received or is being 
requested for several of these projects from the IUBS. One is the project 
on the teaching of biometry, which was initiated with a questionnaire 
sent to all members with their membership cards for 1950. A second is 
the publication of the proceedings of the Second International Biometric 
Conference in BIOMETRICS which was held last year in Geneva. The 
third project is an international symposium to be held in India in Decem- 
ber, 1951, for which plans are now being initiated. This proposal was 
given first priority among IUBS-supported symposia for 1951, with the 
title “Problémes biométriques dans la prévision et V’estimation de la 
croissance des végétaux dans les régions tropicales et subtropicales’’. 
The symposium will be synchronized with a meeting of the International 
Statistical Institute and with the annual meeting of the Indian Region of 
the Biometric Society. 

Officers of the TUBS elected for the period 1950-1953 were President, 
Professor Munro Fox, Bedford College for Women, London; Vice- 
President, Professor J. Runnstrém, Stockholm. The session re-elected 
Secretary-General, Professor P. Vayssiere, Paris; Secretary, Professor 
Stuart Mudd, Philadelphia, and Treasurer, Professor F. Chodat, Geneva. 
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THE BIOMETRIC SOCIETY ACQUIRES BIOMETRICS 


BIOMETRICS is now the journal of the Society, for which we are 
both financially and editorially responsible. It was started during 1945 
as a small bimonthly “Biometrics Bulletin’, primarily for the interchange 
of ideas in the absence of national meetings during the war. In 1947 it 
began quarterly publication, shortened its name to ‘Biometrics’ and 
in December carried the proceedings of the international biometric 
conference in Woods Hole at which The Biometric Society was formed. 
The new Society arranged to have BIOMETRICS sent to all of its 
members who were not already subscribers. 

As the Society grew, BIOMETRICS was continued as its official 
journal through the cooperation of the American Statistical Association 
and its Biometrics Section. It soon became apparent, however, that 
with our international status, we could not depend indefinitely upon the 
generosity of a national association. Early in 1949 the Society approached 
the ASA concerning the possibility of its transferrmg BIOMETRICS 
to the Society as an alternative to starting its own journal. Terms pro- 
posed for the transfer were discussed through 1949 and approved in 
principle at the annual meeting of the Biometrics Section in December 
and by the Board of Directors and Council of the ASA. 

The ASA named Lowell J. Reed, its president-elect, and Harold F. 
Dorn, chairman of its Biometrics Section, to arrange the transfer with 
J. W. Hopkins, C. I. Bliss, Gertrude M. Cox and Arthur Linder, repre- 
senting the Society. The agreement was put in legal form and signed in 
August 1950 as of March 1, 1950. Although The Biometric Society has 
assumed financial responsibility beginning with the first issue of this 
year, the September issue was the first to appear under our imprint. 

The initial paragraph of the agreement notes that for the purpose of 
improving publication conditions in the field of biometry and with a view 
to the development of closer working relations between the Biometrics 
Section of the ASA and the Society, the two organizations have agreed 
to the transfer of BIOMETRICS by the ASA to the Society under 
terms which may be summarized as follows: 

1. The ASA transfers to the Society its rights and title to the March 
1950 and subsequent issues of BIOMETRICS but assumes all obligations 
in respect to the volume completed as of December 1949. 

2. The Society assumes all obligations to produce the March 1950 and 
subsequent issues of BIOMETRICS. 

3. The Society agrees that for five years from the beginning of 1950, 
all members of the ASA qualifying under Article 3, Section 1 of the ASA 
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constitution may order BIOMETRICS through the ASA at block sub- 
scription rates equal to the amount allocated to BIOMETRICS in the 
subscriptions of American members of the Society. 

4. The ASA transfers to the Society all existing undistributed back 
issues of BIOMETRICS. For a period of five years, one-half of the net 
profits from the sale of such back issues shall revert to the ASA. 

5. If the Society proposes to discontinue the publication of BIO- 
METRICS before the end of the last issue in 1954 it shall notify the 
ASA and upon receiving its written request shall transfer and reassign 
to ASA all its right and title to BIOMETRICS together with all un- 
distributed back issues, free of any financial obligation. 

6. In recognition of the support given to the journal in its initial 
years by the ASA and its Biometrics Section, the Society agrees that the 
title page of BIOMETRICS shall bear the words ‘Founded by the 
Biometrics Section of the American Statistical Association” or their 
equivalent. 

7. The Society agrees that one member of the editorial board of 
BIOMETRICS may be nominated by the Biometrics Section of the 
ASA to serve for a term of three years from the date of such nomination, 
the nominee to be approved by the editor of BIOMETRICS. 

8. This agreement shall inure to the benefit of and be binding upon 
the successors and assigns of the parties hereto. 

Under Society sponsorship we hope that the Journal will continue its 
steady development and exert an increasingly broad and salutary in- 
fluence upon biometrical standards all over the world. An editoral board 
of international character will shortly be named to determine policy. 
We have been fortunate in having Professor Gertrude M. Cox continue 
as editor, and in the support given by her associates in the Institute of 
Statistics of The University of North Carolina. 


BIOMETRICS 


Contents of Volume VI 


ABSTRACTS 


NEWS AND NOTES 


QUERIES 


THE BIOMETRIC SOCIETY 


ARTICLES and ABSTRACTS 
ANSCOMBE, F. J., Abstract #83 
BAHADUR, RAGHU RAJ, 
Abstract #121 

BANERJEE, BASUDEB and 
ANUKUL CHANDRA DAS, 
Abstract #96 

BARTLETT, M.S., Teaching and 
Education in Biometry 

BERKSON, JOSEPH, Some Ob- 
servations with Respect to the 
Error of Bio-assay 

BOAG, J. W., Abstract #84 

BOERI, ENZO, On the Mathe- 
matical Theory of the Equi- 
librium of Interactions between 
Proteins and other Substances 

BOSE, RAJ CHANDRA, Abstract 

#108 

BOX, G. E. P., Problems in the 
Analysis of Growth and Wear 
Curves 

BRADLEY, RALPH A., Abstract 
#131 

BRECHER, GEORGE, see 
MARVIN SCHNEIDERMAN 

BROSS, IRWIN, Abstract #112 
Estimates of the LDso: A Critique 

BRYAN, A. HUGHES, see 
B. G. GREENBERG 

CAVALLI, LUIGI L., The Analy- 
sis of Selection Curves 

CHAND, UTTAM, Abstract #130 

COCHRAN, W. G., Abstract (Pro- 
ceedings of Second International 
Biometric Conference) 

Abstract #105 

Estimation of Bacterial Densi- 
ties by Means of the ‘Most 
Probable Number”’ 


103 


185 


174 


85 


432 
103 


181 
413 


208 
190 


75 
178 


105 


443 


103, 169 
231, 348 

99, 164, 293, 435 
195, 300, 438 


COHEN, A. C., JR., Abstract 
#125 

COX, GERTRUDE M., Abstract 
(Proceedings of Second Inter- 
national Biometric Conference) 

CURETON, EDWARD E., 
Abstract #119 

CUZIN, J., see D. SCHWARTZ 

DANDEKAR, V. M., Abstract 
#95 

DAS, ANUKUL CHANDRA, see 
BASUDEB BANERJEE 

DAVIES, O. L., Abstract (Pro- 
ceedings of Second International 
Biometric Conference) 

DAVIES, O. L., and W. A. HAY, 
The Construction and Uses of 
Fractional Factorial Designs in 
Industrial Research 

DAVIS, R. C., Abstract #128 

DENSEN, P. M., Abstract #89 

DORN, HAROLD F., Abstract 
#91 

DULBECCO, R., see S. E. LURIA 

ELIASSEN, ROLF, Statistical 
Analysis in Sanitary Engineer- 
ing Laboratory Studies 

ELFVING, G., and J. H. WHIT- 
LOCK, A Simple Trend Test 
with Application to Erythrocyte 
Size Data 

FEDERER, W. T., The General 
Theory of Prime-Power Lattice 
Designs, V 

FIELLER, E. C., Abstract #102 

FERTIG, J. W., and A. N. HEL- 
LER, The Application of Statis- 
tical Techniques to Sewage 
Treatment Processes 


187 


301 


184 


173 


228 


233 
190 
170 


172 


117 


282 


34 


176 


127 


444 


FISHER, R. A., The Significance 
of Deviations from Hxpectation 
in a Poisson Series 
Gene Frequencies in a Cline De- 
termined by Selection and Diffu- 
sion 

FINNEY, D. J., Scores for the 
Estimation of Parameters 

FREEMAN, MURRAY F. and 
JOHN W. TUKEY, Abstract 
#109 

GHURYE, S. G., Abstract #103 

GREENBERG, B. G. and A. 
HUGHES BRYAN, Abstract 
#1138 

GREENHOUSE, SAMUEL W. 
and NATHAN MANTEL, Ab- 
stract #94 

GREENHOUSE, SAMUEL W. 
and NATHAN MANTEL, The 
Evaluation of Diagnostic Tests 

GRIDGEMAN, N. T., Abstract 
#100 

GRUNDY, P. M., The Estima- 
tion of Error in Rectangular 
Lattices 

HANNAN, JAMES F., Abstract 
#132 

HARRIS, T. E., PAUL MEIER 
and JOHN W. TUKHY, Ab- 
stract #90 

HAY, W. A., see O. L. DAVIES 

HEALY, M. J. R., The Planning 
of Probit Assays 

HELLER, A. N., see J. W. 
FERTIG 

HENDERSON, C. R., Abstract 
# 124 

HOEFFDING, WASSILY, Ab- 
stract #104 

HOPKINS, J. W., A Procedure for 
Quantifying Subjective Apprais- 
als of Odor, Flavor and Texture 
of Foodstuffs 

HOUSEHOLDER, A. S., Abstract 
#114 

IRWIN, J. O., Abstract (Pro- 
ceedings of Second International 
Biometric Conference) 


353 


192 


424 


186 


320 


BIOMETRICS, DECEMBER 1950 


ISAACSON, STANLEY L., Ab- 
stract #107 

KALLIANPUR, GOPINATH, 
Abstract #126 

KAWADA, YUKIYOSI, Abstract 


#122 

KIMBALL, A. W., see D. F. 
VOTAW 

KING, NANCY, see MILDRED 
A. NORVAL 

LANDAHL, H. D., Abstract 
#116 

LUCAS, H. L., Abstract #106 

IGCHRIEN, TS, USE ehekel IR, IDO; 


BECCO, Abstract #87 

MANTEL, NATHAN, see 
SAMUEL W. GREENHOUSE 

MEIER, PAUL, see T. E. 
HARRIS 

MERRILL, M., see E. V. 
NEWMAN 

MORAN, P. A. P., Some Re- 
marks on Animal Population 
Dynamics 

MOSHMAN, JACK, Abstract 
#118 

NASS, C. A. G., Abstract (Pro- 
ceedings of Second International 
Biometric Conference) 

NEWMAN, E. V., and M. 
MERRILL, Abstract #88 

NICHOLSON, GEORGE E., JR., 
Abstract #120 

NORVAL, MILDRED A. and 
NANCY KING, A Biometric 
Study of the Excretion of Cor- 
ticosteroids in Children in Rela- 
tion to Age, Height and Weight 

OAKLAND, G. B., An Applica- 
tion of Sequential Analysis to 
Whitefish Sampling 

OWEN, A. R. G., Abstract #85 

PERRY, W. L. M., Abstract 
(Proceedings of Second Inter- 
national Biometric Conference) 

POTI, 8. JANARDAN, Abstract 
#98 

POWERS, LE ROY, Determining 
Scales and the Use of Transfor- 


183 
179 


169 


250 


184 


345 


169 


184 


395 


59 
104 


322 


174 


INDEX 


mations in Studies on Weight 
Per Locule of Tomato Fruit 145 
QUENOUILLE, M. H., Multi- 
variate Experimentation 303 
RAFFERTY, J. A., Abstract #111 181 
PATHE RUnY seem AceseeD).) Be 
VOTAW 
RAO, C. RADHAKRISHNA, 


Abstract #99 175 
RAO, S. RAJA, Abstract #97 174 
RAPOPORT, ANATOL, Abstract 

#115 183 

Outline of a Mathematical The- 

ory of Peck Right 330 
REEVE, E. and F. W. ROBERT- 

SON, Abstract #86 104 


RENTER, A., see D. SCHWARTZ 
ROBBINS, HERBERT E., Ab- 
stract #129 190 
ROBERTSON, F. W., see E. 
REEVE 
ROY, 8S. N., Abstract #127 189 
SANDELIUS, D. MARTIN, Ab- 
stract #137 193 
An Inverse Sampling Procedure 
for Bacterial Plate Counts 291 
SCHNEIDERMAN, MARVIN, 
and GEORGE BRECHER, The 
Relative Frequency of Sparse 
Cel] Elements—An Application 
of Reticulocyte Blood Counts 390 
SCHWARTZ, D., J. CUZIN and 
A. RENIER, Abstract (Proceed- 


445 


ings of Second International 


Biometric Confer rence) 344 
SHRIKHANDE, S. S. Abstract 

#134 193 

#135 193 

#136 193 


STEVENSON, STUART §&., see 
JANE WORCESTER 
TUKEY, JOHN W., see T. E. 
HARRIS 
see MURRAY F. FREEMAN 


VERLINDEN, F. J., Abstract 
#110 180 

VORA, SHANTILAL AMIDAS, 
Abstract #123 185 


VOTAW, D. F., JR., A. W. KIM- 
BALL and J. A. RAFFERTY, 
Compound Symmetry Tests in 
the Multivariate Analysis of 
Medical Experiments 259 

WADLEY, F. M., Abstract #117 184 

WALSH, JOHN E., Abstract #133 192 

WHITLOGCIG Wi Elysee) G: 
ELFVING 

WOOD, E. C., Abstract #101 175 

WORCESTER, JANE, and STU- 
ARTS. STEVENSON, Abstract 
#92 172 

YATES, FRANK, Experimental 
Techniques in Plant Improve- 
ment 200 

YOUDEN, W. J., Abstract #93 172 
A Note on the Four by Four 
Latin Squares 289 


INDEX 


Acceptance area, 62 

Adjusted means, 46, 56 

Alcoholism, 435 

Aliases, 238 

Analysis of covariance, 15, 164, 184, 
293, 294, 297 

Analysis of variance, 8, 25, 35, 50, 99, 
141, 259, 295, 369 

Angular transformation, 1 10, 15, 321 

ae ese sample number, 65 


Bacon, 7 
Bacteriology, 105, 127, 169, 181, 291 


Behrens-Fisher problem, 192 

Between-block error, 25 

Bias, 13, 100 

Binomial, 10, 173 

Bioassay, 99, 174, 175, 176, 320, 322, 
4138, 424, 432 

Biochemical oxygen demand, 122 

Biometry, 75, 228 

Birth rate, 256 

Biserial correlation, 400 

Blood counts, 390 

Blood groups, 174 


446 


Cancer, 103 

Chemical analysis, 114, 295 

Chemical industry, 228, 233 

Chi square, 17, 133, 148, 168, 178, 182, 
185, 218, 291, 298, 321 

Clinical statistics, 103, L253 99 

Coding, 35 

Coefficient of variation, 49, 58, 118 

Combination of data, 176 

Components of variance, 8, 25, 136, 
179, 368 

Confidence limits, 114, 136, 185 

Controls, 201, 205 

Correlation, 185, 344 
mean with variance, 10, 318, 435 

Covariance, 411 

Critical point, 403 

Critical ratio, 298 

Curve fitting, 120, 166, 210, 360 

Cycles, 251 

Death rate, 256 

Design of experiments, 13, 15, 34, 79, 
102, 107, 110, 117, 124, 146, 167, 181, 
198, 201, 228, 233, 301, 303, 317, 318, 
390, 424 

Diagnosis, 172, 173, 282, 399 

Digitalis, 322 

Dilution curve, 169 

Dilution series, 105, 128, 181 

Diphtheria antitoxin, 326 

Discriminant functions, 184, 303 

Disproportionate numbers, 179 

Distributions, 60, 148, 171, 174, 178, 
192, 275, 415 

Doolittle method, 179 

Dosage response, 174 

D statistic, 175 

Dummy variable, 64, 311 

Efficiency, 45, 56, 202, 224, 247, 286, 
302 

Empirical distribution, 192 

Error variance, 25, 45, 175, 289, 398 

Erythrocytes, 282 

Estimation, 105, 108, 176, 185, 186, 
187, 188, 190, 193, 310, 227, 287 

Exact distribution, 19 

Experimental design, see Design 

Factorial design, 203 
fractional, 228, 233 

Fiducial limits, 14, 136, 175, 321, 327, 
425, 435 

Field experiments, 201 

Fisheries, 59 

Fitting distributions, 148 

Food technology, 1 

Forensic statistics, 435 

F test, 265 

Generalized distance, 175 

Genetics, 104, 175, 182, 186, 200, 208, 
221, 226, 227, 353 

Genetic variance, 104, 141, 146, 150, 
204, 219 

Geometric mean, 146 


BIOMETRICS, DECEMBER, 1950 


Gram-Charlier series, 174 

Graphical calculation, 175 

Grouping, 21 

Growth curve, 310, 362, 388 

Hematology, 184 

Heteroscedasticity, 101 

Hypothesis, 259, 372 

Incomplete beta function, 275 

Incomplete blocks, 1, 44, 55, 201, 362 

Incubation time, 344 

Index of dispersion, 17 

Industrial research, 228, 233 

Inference, 189 

Information, 45, 54, 180, 213 

Interaction, 10, 51 

Inverse matrices, 180 

Inverse sampling, 291 

Inverse sine transformation, see 
Angular 

Judgments, 1, 102, 206 

Kurtosis, 103 

Latin squares, 180, 202, 289, 318 

Lattices, 1, 25, 34, 302 

LDs , 413, 4382 

Least squares, 10, 119 

Legit, 359 

Likelihood, 19 

Logit, 321, 359, 415, 432 

Log-normal distribution, 103, 104, 146 

Log transformation, 146 

Mathematical biology, 380, 342, 347 

Mathematical model, 8, 169, 181, 183, 
287, 330, 342, 353, 367 

Matrices, 180 

Maximum likelihood, 110, 194, 212, 

224, 361, 413, 421, 432 

Medical research, 259, 485 

Metameter, 101, 145 

Method of moments, 122 

Metric, 145, 183 

Milk powder, 4 

Miller dise, 391 

Minimax estimate, 188 

Minimum chi square, 414, 432 

Mode, 103 

Morbidity, 170 

Mortality, 170 

Most probable number, 105, 127 

Multivariate analysis, 259, 303, 378 

Natural selection, 353 

Negative binomial, 60, 103, 193 

Neural net, 183 

Normal distribution, 145, 174 

Objectivity, 319 

Odor, 2 

Operating characteristic, 63 

Opposing curvature, 100 

Organoleptic tests, 1 

Orthogonality, 179 

Partial factorial design, 228 

Partial regression, 168, 293 

Partitions, 20 

Pearsonian curves, 321 


INDEX 


Peck order, 104, 330, 347 

Percentages, 178, 298 

Physiology, 183, 395 

Plankton, 142 

Plant breeding, 200, 226 

Plot dimensions, 202 

Poisson, 17, 103, 178, 193, 291, 391 

Polynomials, fitting, 180, 317 

Population, 103, 250 

Prediction, 184, 398 

Probability paper, 180 

Probits, 321, 359, 418, 424, 432 

Pseudo-factorial, 35 

Psychometry, 1, 184 

Quadratic forms, 185 

Quantification, 1 

Radioactivity, 123 

Randomization, 35, 317 

Randomized blocks, 44, 55, 146, 302 

Ranking, 1, 177, 282 

Rectangular lattice, 25 

Regression analysis, 15, 294, 317, 437 

Regression coefficient, 168 

Regression equation, 5 

Regression, non-linear, 120, 166, 180, 
294 


Rejection area, 62 

Replication, 25 

Residuals, 315 

Respiration, 183 

Reversal experiments, 312 
Sampling, 59, 103, 174, 291, 390, 402 
Sampling distribution, 14, 17, 19 
Sanitary engineering, 117, 127 
Seales, 145 

Scedasticity, 10 

Scores, 1, 99, 173, 213, 221, 227 
Selection, 203, 208, and see Natural 
Selection-diffusion transformation, 359 
Sensory, 1 

Sequential analysis, 59, 193 


447 


Serology, 345 

Sewage, 117, 127 

Significance, see Test 

Skewness, 14, 103, 114, 174 

Small samples, 113, 413 

Sociology, 330 

Square-root transformations, 180 

Standard error, 47, 58, 112, 129, 218, 
434 

Statistical control, 435 

Stochastic processes, 92, 251 

Subjectivity, 1, 319 

Sufficient estimate, 17 

Survival time, 99, 104 

Symmetry, 259 

Taste, 3, 102, 206 

Taxonomy, 184 

Teaching statistics, 85 

Test of significance, 10, 14, 17, 100, 114, 
167, 174, 175, 177, 178, 179, 192, 227, 
259, 285, 308, 374, 386, 400 

Test of significance, non-normal data, 
191 


Tetrads, 182 

Time series, 176, 190 

Tobacco mosaic, 344 

Transformations, 10, 101, 145, 180, 359, 
437 

Trend, 282 

Truncated distribution, 186 

T test, 124, 190, 298 

Tuberculosis, 172 

Uniformity trial, 34 

Variance, 8, 17, 275, 285, 288, 411 
analysis of, see Analysis 
homogeneity of, 14 

Wear curve, 362 

Weights, 10, 15, 26, 32, 43, 54, 224 

Wood decay, 296 

Yates’ correction, 298 


